mercurial-scm/hg-stable: mercurial/archival.py annotate

annotate mercurial/archival.py @ 51897:b60f25f00e94

typing: add explicit hints for recent pytype regressions Somewhere between 454feddab720 and cd72a88c5599, pytype changed how it inferred the return type in `extdiff.py` from Tuple[Any, List[Tuple[bytes, Any, os.stat_result]]] to Tuple[Any, List[nothing]] It also changed the return type in `archival.py` from `Any` to `NoReturn`. Fix those up, and also the obvious parameter types while we're here.

author	Matt Harbison <matt_harbison@yahoo.com>
date	Thu, 12 Sep 2024 12:28:27 -0400
parents	3b8d92f71d92
children	f81e0ce5103a

rev	line source
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	1 # archival.py - revision archival for mercurial
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	2 #
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	3 # Copyright 2006 Vadim Gelfer <vadim.gelfer@gmail.com>
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	4 #
8225 46293a0c7e9f updated license to be explicit about GPL version 2 Martin Geisler <mg@lazybytes.net> parents: 7770 diff changeset	5 # This software may be used and distributed according to the terms of the
10263 25e572394f5c Update license to GPLv2+ Matt Mackall <mpm@selenic.com> parents: 9614 diff changeset	6 # GNU General Public License version 2 or any later version.
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	7
25916 c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	8
c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	9 import gzip
c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	10 import os
17628 133d13e44544 archival: add "extended-timestamp" extra block for zip archives (issue3600) FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 17108 diff changeset	11 import struct
25916 c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	12 import tarfile
c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	13 import time
51897 b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	14 import typing
25916 c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	15 import zipfile
c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	16 import zlib
c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	17
51897 b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	18 from typing import (
b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	19 Optional,
b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	20 )
b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	21
25916 c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	22 from .i18n import _
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	23 from .node import nullrev
43085 eef9a2d67051 py3: manually import pycompat.open into files that need it Gregory Szorc <gregory.szorc@gmail.com> parents: 43077 diff changeset	24 from .pycompat import open
25916 c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	25
c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	26 from . import (
c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	27 error,
33544 4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	28 formatter,
25916 c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	29 match as matchmod,
36730 bfe23afea361 archival: fsdecode paths before passing to tar or zip objects Augie Fackler <augie@google.com> parents: 36477 diff changeset	30 pycompat,
36177 b72c6ff4e4c0 archive: migrate to the fileprefetch callback mechanism Matt Harbison <matt_harbison@yahoo.com> parents: 36074 diff changeset	31 scmutil,
25916 c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	32 util,
31245 7feab0e7702d vfs: use 'vfs' module directly in 'mercurial.archival' Pierre-Yves David <pierre-yves.david@ens-lyon.org> parents: 31226 diff changeset	33 vfs as vfsmod,
25916 c1777ece502a archival: use absolute_import Gregory Szorc <gregory.szorc@gmail.com> parents: 25725 diff changeset	34 )
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	35
48035 406a7e629946 archival: force a `CompressionError` to bytes before passing to `error.Abort` Matt Harbison <matt_harbison@yahoo.com> parents: 45957 diff changeset	36 from .utils import stringutil
406a7e629946 archival: force a `CompressionError` to bytes before passing to `error.Abort` Matt Harbison <matt_harbison@yahoo.com> parents: 45957 diff changeset	37
51897 b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	38 if typing.TYPE_CHECKING:
b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	39 from . import (
b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	40 localrepo,
b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	41 )
b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	42
28861 86db5cb55d46 pycompat: switch to util.stringio for py3 compat timeless <timeless@mozdev.org> parents: 28017 diff changeset	43 stringio = util.stringio
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	44
17429 72fa4ef2245f declare local constants instead of using magic values and comments Mads Kiilerich <mads@kiilerich.com> parents: 17108 diff changeset	45 # from unzip source code:
72fa4ef2245f declare local constants instead of using magic values and comments Mads Kiilerich <mads@kiilerich.com> parents: 17108 diff changeset	46 _UNX_IFREG = 0x8000
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	47 _UNX_IFLNK = 0xA000
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	48
17429 72fa4ef2245f declare local constants instead of using magic values and comments Mads Kiilerich <mads@kiilerich.com> parents: 17108 diff changeset	49
11558 d8f6458434ec archival: remove prefix argument from archivers Martin Geisler <mg@lazybytes.net> parents: 11557 diff changeset	50 def tidyprefix(dest, kind, prefix):
45957 89a2afe31e82 formating: upgrade to black 20.8b1 Augie Fackler <raf@durin42.com> parents: 45084 diff changeset	51 """choose prefix to use for names in archive. make sure prefix is
89a2afe31e82 formating: upgrade to black 20.8b1 Augie Fackler <raf@durin42.com> parents: 45084 diff changeset	52 safe for consumers."""
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	53
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	54 if prefix:
5842 111ed8c871bf Use util.normpath() instead of direct path string operation. Shun-ichi GOTO <shunichi.goto@gmail.com> parents: 4951 diff changeset	55 prefix = util.normpath(prefix)
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	56 else:
36467 745b0df08514 py3: use bytes instead of str in isinstance Pulkit Goyal <7895pulkit@gmail.com> parents: 36177 diff changeset	57 if not isinstance(dest, bytes):
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	58 raise ValueError(b'dest must be string if no prefix')
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	59 prefix = os.path.basename(dest)
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	60 lower = prefix.lower()
11558 d8f6458434ec archival: remove prefix argument from archivers Martin Geisler <mg@lazybytes.net> parents: 11557 diff changeset	61 for sfx in exts.get(kind, []):
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	62 if lower.endswith(sfx):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	63 prefix = prefix[: -len(sfx)]
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	64 break
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	65 lpfx = os.path.normpath(util.localpath(prefix))
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	66 prefix = util.pconvert(lpfx)
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	67 if not prefix.endswith(b'/'):
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	68 prefix += b'/'
24953 5115d03440f4 archive: drop the leading '.' path component from the prefix (issue4634) Matt Harbison <matt_harbison@yahoo.com> parents: 24681 diff changeset	69 # Drop the leading '.' path component if present, so Windows can read the
5115d03440f4 archive: drop the leading '.' path component from the prefix (issue4634) Matt Harbison <matt_harbison@yahoo.com> parents: 24681 diff changeset	70 # zip files (issue4634)
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	71 if prefix.startswith(b'./'):
24953 5115d03440f4 archive: drop the leading '.' path component from the prefix (issue4634) Matt Harbison <matt_harbison@yahoo.com> parents: 24681 diff changeset	72 prefix = prefix[2:]
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	73 if prefix.startswith(b'../') or os.path.isabs(lpfx) or b'/../' in prefix:
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	74 raise error.Abort(_(b'archive prefix contains illegal components'))
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	75 return prefix
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	76
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	77
11557 57bdc2239535 archival: move commands.archive.guess_type to archival.guesskind Martin Geisler <mg@lazybytes.net> parents: 10282 diff changeset	78 exts = {
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	79 b'tar': [b'.tar'],
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	80 b'tbz2': [b'.tbz2', b'.tar.bz2'],
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	81 b'tgz': [b'.tgz', b'.tar.gz'],
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	82 b'zip': [b'.zip'],
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	83 b'txz': [b'.txz', b'.tar.xz'],
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	84 }
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	85
11557 57bdc2239535 archival: move commands.archive.guess_type to archival.guesskind Martin Geisler <mg@lazybytes.net> parents: 10282 diff changeset	86
57bdc2239535 archival: move commands.archive.guess_type to archival.guesskind Martin Geisler <mg@lazybytes.net> parents: 10282 diff changeset	87 def guesskind(dest):
49004 f254fc73d956 global: bulk replace simple pycompat.iteritems(x) with x.items() Gregory Szorc <gregory.szorc@gmail.com> parents: 48984 diff changeset	88 for kind, extensions in exts.items():
25149 3f0744eeaeaf cleanup: use __builtins__.any instead of util.any Augie Fackler <augie@google.com> parents: 24953 diff changeset	89 if any(dest.endswith(ext) for ext in extensions):
11557 57bdc2239535 archival: move commands.archive.guess_type to archival.guesskind Martin Geisler <mg@lazybytes.net> parents: 10282 diff changeset	90 return kind
57bdc2239535 archival: move commands.archive.guess_type to archival.guesskind Martin Geisler <mg@lazybytes.net> parents: 10282 diff changeset	91 return None
57bdc2239535 archival: move commands.archive.guess_type to archival.guesskind Martin Geisler <mg@lazybytes.net> parents: 10282 diff changeset	92
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	93
24681 33ab99a6ad9b archive: look for first visible revision to build repo identity (issue4591) Yuya Nishihara <yuya@tcha.org> parents: 24678 diff changeset	94 def _rootctx(repo):
33ab99a6ad9b archive: look for first visible revision to build repo identity (issue4591) Yuya Nishihara <yuya@tcha.org> parents: 24678 diff changeset	95 # repo[0] may be hidden
33ab99a6ad9b archive: look for first visible revision to build repo identity (issue4591) Yuya Nishihara <yuya@tcha.org> parents: 24678 diff changeset	96 for rev in repo:
33ab99a6ad9b archive: look for first visible revision to build repo identity (issue4591) Yuya Nishihara <yuya@tcha.org> parents: 24678 diff changeset	97 return repo[rev]
39899 d739f423bf06 repo: look up nullrev context by revnum, not symbolic name Martin von Zweigbergk <martinvonz@google.com> parents: 38387 diff changeset	98 return repo[nullrev]
24681 33ab99a6ad9b archive: look for first visible revision to build repo identity (issue4591) Yuya Nishihara <yuya@tcha.org> parents: 24678 diff changeset	99
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	100
35945 887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	101 # {tags} on ctx includes local tags and 'tip', with no current way to limit
887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	102 # that to global tags. Therefore, use {latesttag} as a substitute when
887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	103 # the distance is 0, since that will be the list of global tags on ctx.
887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	104 _defaultmetatemplate = br'''
887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	105 repo: {root}
887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	106 node: {ifcontains(rev, revset("wdir()"), "{p1node}{dirty}", "{node}")}
887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	107 branch: {branch\|utf8}
887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	108 {ifeq(latesttagdistance, 0, join(latesttag % "tag: {tag}", "\n"),
887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	109 separate("\n",
887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	110 join(latesttag % "latesttag: {tag}", "\n"),
887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	111 "latesttagdistance: {latesttagdistance}",
887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	112 "changessincelatesttag: {changessincelatesttag}"))}
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	113 '''[
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	114 1:
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	115 ] # drop leading '\n'
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	116
35945 887bbce7f491 archive: rewrite default metadata template as a multi-line bytes literal Yuya Nishihara <yuya@tcha.org> parents: 35358 diff changeset	117
24678 fbcace19534f archive: extract metadata() closure to module-level function Yuya Nishihara <yuya@tcha.org> parents: 24677 diff changeset	118 def buildmetadata(ctx):
fbcace19534f archive: extract metadata() closure to module-level function Yuya Nishihara <yuya@tcha.org> parents: 24677 diff changeset	119 '''build content of .hg_archival.txt'''
fbcace19534f archive: extract metadata() closure to module-level function Yuya Nishihara <yuya@tcha.org> parents: 24677 diff changeset	120 repo = ctx.repo()
33544 4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	121
4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	122 opts = {
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	123 b'template': repo.ui.config(
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	124 b'experimental', b'archivemetatemplate', _defaultmetatemplate
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	125 )
33544 4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	126 }
4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	127
4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	128 out = util.stringio()
24678 fbcace19534f archive: extract metadata() closure to module-level function Yuya Nishihara <yuya@tcha.org> parents: 24677 diff changeset	129
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	130 fm = formatter.formatter(repo.ui, out, b'archive', opts)
33544 4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	131 fm.startitem()
4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	132 fm.context(ctx=ctx)
4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	133 fm.data(root=_rootctx(repo).hex())
4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	134
4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	135 if ctx.rev() is None:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	136 dirty = b''
33544 4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	137 if ctx.dirty(missing=True):
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	138 dirty = b'+'
33544 4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	139 fm.data(dirty=dirty)
4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	140 fm.end()
4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	141
4c4e95cae33a archive: use a templater to build the metadata file Matt Harbison <matt_harbison@yahoo.com> parents: 33499 diff changeset	142 return out.getvalue()
11557 57bdc2239535 archival: move commands.archive.guess_type to archival.guesskind Martin Geisler <mg@lazybytes.net> parents: 10282 diff changeset	143
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	144
49037 642e31cb55f0 py3: use class X: instead of class X(object): Gregory Szorc <gregory.szorc@gmail.com> parents: 49004 diff changeset	145 class tarit:
45957 89a2afe31e82 formating: upgrade to black 20.8b1 Augie Fackler <raf@durin42.com> parents: 45084 diff changeset	146 """write archive to tar file or stream. can write uncompressed,
89a2afe31e82 formating: upgrade to black 20.8b1 Augie Fackler <raf@durin42.com> parents: 45084 diff changeset	147 or compress with gzip or bzip2."""
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	148
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	149 def __init__(self, dest, mtime, kind=b''):
2477 857591c586e0 use commit time as mtime for file archives. Vadim Gelfer <vadim.gelfer@gmail.com> parents: 2353 diff changeset	150 self.mtime = mtime
13400 14f3795a5ed7 explicitly close files Dan Villiom Podlaski Christiansen <danchr@gmail.com> parents: 13144 diff changeset	151 self.fileobj = None
4652 06de65673ec2 timestamp of gzip archives taken from changeset context csaba.henk@creo.hu parents: 4370 diff changeset	152
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	153 def taropen(mode, name=b'', fileobj=None):
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	154 if kind == b'gz':
36477 588048a6a8d3 py3: slice over bytes or use .startswith() to prevent getting ascii values Pulkit Goyal <7895pulkit@gmail.com> parents: 36467 diff changeset	155 mode = mode[0:1]
4652 06de65673ec2 timestamp of gzip archives taken from changeset context csaba.henk@creo.hu parents: 4370 diff changeset	156 if not fileobj:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	157 fileobj = open(name, mode + b'b')
48973 640e1cb6a7de archival: remove GzipFileWithTime Gregory Szorc <gregory.szorc@gmail.com> parents: 48966 diff changeset	158 gzfileobj = gzip.GzipFile(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	159 name,
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	160 pycompat.sysstr(mode + b'b'),
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	161 zlib.Z_BEST_COMPRESSION,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	162 fileobj,
44205 6c36a521572e gzip: rename the argument to `mtime` to match upstream python Pierre-Yves David <pierre-yves.david@octobus.net> parents: 43554 diff changeset	163 mtime=mtime,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	164 )
13400 14f3795a5ed7 explicitly close files Dan Villiom Podlaski Christiansen <danchr@gmail.com> parents: 13144 diff changeset	165 self.fileobj = gzfileobj
45957 89a2afe31e82 formating: upgrade to black 20.8b1 Augie Fackler <raf@durin42.com> parents: 45084 diff changeset	166 return (
49898 55d45d0de4e7 typing: add type hints to pycompat.bytestr Matt Harbison <matt_harbison@yahoo.com> parents: 49037 diff changeset	167 # taropen() wants Literal['a', 'r', 'w', 'x'] for the mode,
55d45d0de4e7 typing: add type hints to pycompat.bytestr Matt Harbison <matt_harbison@yahoo.com> parents: 49037 diff changeset	168 # but Literal[] is only available in 3.8+ without the
55d45d0de4e7 typing: add type hints to pycompat.bytestr Matt Harbison <matt_harbison@yahoo.com> parents: 49037 diff changeset	169 # typing_extensions backport.
55d45d0de4e7 typing: add type hints to pycompat.bytestr Matt Harbison <matt_harbison@yahoo.com> parents: 49037 diff changeset	170 # pytype: disable=wrong-arg-types
45957 89a2afe31e82 formating: upgrade to black 20.8b1 Augie Fackler <raf@durin42.com> parents: 45084 diff changeset	171 tarfile.TarFile.taropen( # pytype: disable=attribute-error
89a2afe31e82 formating: upgrade to black 20.8b1 Augie Fackler <raf@durin42.com> parents: 45084 diff changeset	172 name, pycompat.sysstr(mode), gzfileobj
89a2afe31e82 formating: upgrade to black 20.8b1 Augie Fackler <raf@durin42.com> parents: 45084 diff changeset	173 )
49898 55d45d0de4e7 typing: add type hints to pycompat.bytestr Matt Harbison <matt_harbison@yahoo.com> parents: 49037 diff changeset	174 # pytype: enable=wrong-arg-types
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	175 )
4652 06de65673ec2 timestamp of gzip archives taken from changeset context csaba.henk@creo.hu parents: 4370 diff changeset	176 else:
44842 2c0043977b6d archival: abort if compression method is unavailable Manuel Jacob <me@manueljacob.de> parents: 44586 diff changeset	177 try:
2c0043977b6d archival: abort if compression method is unavailable Manuel Jacob <me@manueljacob.de> parents: 44586 diff changeset	178 return tarfile.open(
2c0043977b6d archival: abort if compression method is unavailable Manuel Jacob <me@manueljacob.de> parents: 44586 diff changeset	179 name, pycompat.sysstr(mode + kind), fileobj
2c0043977b6d archival: abort if compression method is unavailable Manuel Jacob <me@manueljacob.de> parents: 44586 diff changeset	180 )
2c0043977b6d archival: abort if compression method is unavailable Manuel Jacob <me@manueljacob.de> parents: 44586 diff changeset	181 except tarfile.CompressionError as e:
48035 406a7e629946 archival: force a `CompressionError` to bytes before passing to `error.Abort` Matt Harbison <matt_harbison@yahoo.com> parents: 45957 diff changeset	182 raise error.Abort(stringutil.forcebytestr(e))
4652 06de65673ec2 timestamp of gzip archives taken from changeset context csaba.henk@creo.hu parents: 4370 diff changeset	183
36732 7f9a6f5f7612 archival: our filenames are bytes, not strs Augie Fackler <augie@google.com> parents: 36731 diff changeset	184 if isinstance(dest, bytes):
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	185 self.z = taropen(b'w:', name=dest)
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	186 else:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	187 self.z = taropen(b'w\|', fileobj=dest)
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	188
4831 6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	189 def addfile(self, name, mode, islink, data):
36730 bfe23afea361 archival: fsdecode paths before passing to tar or zip objects Augie Fackler <augie@google.com> parents: 36477 diff changeset	190 name = pycompat.fsdecode(name)
11558 d8f6458434ec archival: remove prefix argument from archivers Martin Geisler <mg@lazybytes.net> parents: 11557 diff changeset	191 i = tarfile.TarInfo(name)
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	192 i.mtime = self.mtime
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	193 i.size = len(data)
4831 6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	194 if islink:
6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	195 i.type = tarfile.SYMTYPE
25658 e93036747902 global: mass rewrite to use modern octal syntax Gregory Szorc <gregory.szorc@gmail.com> parents: 25615 diff changeset	196 i.mode = 0o777
36730 bfe23afea361 archival: fsdecode paths before passing to tar or zip objects Augie Fackler <augie@google.com> parents: 36477 diff changeset	197 i.linkname = pycompat.fsdecode(data)
4831 6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	198 data = None
7770 fd3e5ff53a31 fix disappearing symlinks [issue1509] Peter van Dijk <mercurial-bugs@selenic.com> parents: 6913 diff changeset	199 i.size = 0
4831 6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	200 else:
6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	201 i.mode = mode
28861 86db5cb55d46 pycompat: switch to util.stringio for py3 compat timeless <timeless@mozdev.org> parents: 28017 diff changeset	202 data = stringio(data)
4831 6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	203 self.z.addfile(i, data)
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	204
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	205 def done(self):
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	206 self.z.close()
13400 14f3795a5ed7 explicitly close files Dan Villiom Podlaski Christiansen <danchr@gmail.com> parents: 13144 diff changeset	207 if self.fileobj:
14f3795a5ed7 explicitly close files Dan Villiom Podlaski Christiansen <danchr@gmail.com> parents: 13144 diff changeset	208 self.fileobj.close()
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	209
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	210
49037 642e31cb55f0 py3: use class X: instead of class X(object): Gregory Szorc <gregory.szorc@gmail.com> parents: 49004 diff changeset	211 class zipit:
45957 89a2afe31e82 formating: upgrade to black 20.8b1 Augie Fackler <raf@durin42.com> parents: 45084 diff changeset	212 """write archive to zip file or stream. can write uncompressed,
89a2afe31e82 formating: upgrade to black 20.8b1 Augie Fackler <raf@durin42.com> parents: 45084 diff changeset	213 or compressed with deflate."""
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	214
11558 d8f6458434ec archival: remove prefix argument from archivers Martin Geisler <mg@lazybytes.net> parents: 11557 diff changeset	215 def __init__(self, dest, mtime, compress=True):
40247 844deb408a5b archival: don't try and fsdecode non-{bytes,str} objects Augie Fackler <augie@google.com> parents: 39899 diff changeset	216 if isinstance(dest, bytes):
844deb408a5b archival: don't try and fsdecode non-{bytes,str} objects Augie Fackler <augie@google.com> parents: 39899 diff changeset	217 dest = pycompat.fsdecode(dest)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	218 self.z = zipfile.ZipFile(
43554 9f70512ae2cf cleanup: remove pointless r-prefixes on single-quoted strings Augie Fackler <augie@google.com> parents: 43535 diff changeset	219 dest, 'w', compress and zipfile.ZIP_DEFLATED or zipfile.ZIP_STORED
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	220 )
12319 381f131220ad archive: set date to 1980 for very old zip files Martin Geisler <mg@aragost.com> parents: 10282 diff changeset	221
381f131220ad archive: set date to 1980 for very old zip files Martin Geisler <mg@aragost.com> parents: 10282 diff changeset	222 # Python's zipfile module emits deprecation warnings if we try
381f131220ad archive: set date to 1980 for very old zip files Martin Geisler <mg@aragost.com> parents: 10282 diff changeset	223 # to store files with a date before 1980.
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	224 epoch = 315532800 # calendar.timegm((1980, 1, 1, 0, 0, 0, 1, 1, 0))
12319 381f131220ad archive: set date to 1980 for very old zip files Martin Geisler <mg@aragost.com> parents: 10282 diff changeset	225 if mtime < epoch:
381f131220ad archive: set date to 1980 for very old zip files Martin Geisler <mg@aragost.com> parents: 10282 diff changeset	226 mtime = epoch
381f131220ad archive: set date to 1980 for very old zip files Martin Geisler <mg@aragost.com> parents: 10282 diff changeset	227
17628 133d13e44544 archival: add "extended-timestamp" extra block for zip archives (issue3600) FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 17108 diff changeset	228 self.mtime = mtime
2477 857591c586e0 use commit time as mtime for file archives. Vadim Gelfer <vadim.gelfer@gmail.com> parents: 2353 diff changeset	229 self.date_time = time.gmtime(mtime)[:6]
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	230
4831 6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	231 def addfile(self, name, mode, islink, data):
36730 bfe23afea361 archival: fsdecode paths before passing to tar or zip objects Augie Fackler <augie@google.com> parents: 36477 diff changeset	232 i = zipfile.ZipInfo(pycompat.fsdecode(name), self.date_time)
43535 d5bef33ab83c archival: suppress some incorrect pytype failures Augie Fackler <augie@google.com> parents: 43106 diff changeset	233 i.compress_type = self.z.compression # pytype: disable=attribute-error
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	234 # unzip will not honor unix file modes unless file creator is
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	235 # set to unix (id 3).
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	236 i.create_system = 3
17429 72fa4ef2245f declare local constants instead of using magic values and comments Mads Kiilerich <mads@kiilerich.com> parents: 17108 diff changeset	237 ftype = _UNX_IFREG
4831 6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	238 if islink:
25658 e93036747902 global: mass rewrite to use modern octal syntax Gregory Szorc <gregory.szorc@gmail.com> parents: 25615 diff changeset	239 mode = 0o777
17429 72fa4ef2245f declare local constants instead of using magic values and comments Mads Kiilerich <mads@kiilerich.com> parents: 17108 diff changeset	240 ftype = _UNX_IFLNK
29894 31a6d5e14508 py3: remove use of L syntax Pulkit Goyal <7895pulkit@gmail.com>* parents: 28861 diff changeset	241 i.external_attr = (mode \| ftype) << 16
17628 133d13e44544 archival: add "extended-timestamp" extra block for zip archives (issue3600) FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 17108 diff changeset	242 # add "extended-timestamp" extra block, because zip archives
133d13e44544 archival: add "extended-timestamp" extra block for zip archives (issue3600) FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 17108 diff changeset	243 # without this will be extracted with unexpected timestamp,
133d13e44544 archival: add "extended-timestamp" extra block for zip archives (issue3600) FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 17108 diff changeset	244 # if TZ is not configured as GMT
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	245 i.extra += struct.pack(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	246 b'<hhBl',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	247 0x5455, # block type: "extended-timestamp"
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	248 1 + 4, # size of this block
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	249 1, # "modification time is present"
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	250 int(self.mtime),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	251 ) # last modification (UTC)
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	252 self.z.writestr(i, data)
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	253
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	254 def done(self):
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	255 self.z.close()
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	256
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	257
49037 642e31cb55f0 py3: use class X: instead of class X(object): Gregory Szorc <gregory.szorc@gmail.com> parents: 49004 diff changeset	258 class fileit:
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	259 '''write archive as files in directory.'''
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	260
11558 d8f6458434ec archival: remove prefix argument from archivers Martin Geisler <mg@lazybytes.net> parents: 11557 diff changeset	261 def __init__(self, name, mtime):
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	262 self.basedir = name
31245 7feab0e7702d vfs: use 'vfs' module directly in 'mercurial.archival' Pierre-Yves David <pierre-yves.david@ens-lyon.org> parents: 31226 diff changeset	263 self.opener = vfsmod.vfs(self.basedir)
35212 760fef6aca74 archive: pass thru mtime for directory archives, like other archive types do James May <james.may@draeger.com> parents: 33545 diff changeset	264 self.mtime = mtime
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	265
4831 6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	266 def addfile(self, name, mode, islink, data):
6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	267 if islink:
6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	268 self.opener.symlink(data, name)
6f08bc1bd00b archive: add symlink support Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4830 diff changeset	269 return
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	270 f = self.opener(name, b"w", atomictemp=False)
4830 74f36b1027f4 archive: use util.opener when archiving files. Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4731 diff changeset	271 f.write(data)
15057 774da7121fc9 atomictempfile: make close() consistent with other file-like objects. Greg Ward <greg@gerg.ca> parents: 13970 diff changeset	272 f.close()
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	273 destfile = os.path.join(self.basedir, name)
4830 74f36b1027f4 archive: use util.opener when archiving files. Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4731 diff changeset	274 os.chmod(destfile, mode)
35212 760fef6aca74 archive: pass thru mtime for directory archives, like other archive types do James May <james.may@draeger.com> parents: 33545 diff changeset	275 if self.mtime is not None:
760fef6aca74 archive: pass thru mtime for directory archives, like other archive types do James May <james.may@draeger.com> parents: 33545 diff changeset	276 os.utime(destfile, (self.mtime, self.mtime))
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	277
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	278 def done(self):
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	279 pass
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	280
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	281
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	282 archivers = {
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	283 b'files': fileit,
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	284 b'tar': tarit,
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	285 b'tbz2': lambda name, mtime: tarit(name, mtime, b'bz2'),
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	286 b'tgz': lambda name, mtime: tarit(name, mtime, b'gz'),
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	287 b'txz': lambda name, mtime: tarit(name, mtime, b'xz'),
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	288 b'uzip': lambda name, mtime: zipit(name, mtime, False),
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	289 b'zip': zipit,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	290 }
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	291
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	292
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	293 def archive(
51897 b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	294 repo: "localrepo.localrepository",
b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	295 dest, # TODO: should be bytes, but could be Callable
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	296 node,
51897 b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	297 kind: bytes,
b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	298 decode: bool = True,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	299 match=None,
51897 b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	300 prefix: bytes = b'',
b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	301 mtime: Optional[float] = None,
b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	302 subrepos: bool = False,
b60f25f00e94 typing: add explicit hints for recent pytype regressions Matt Harbison <matt_harbison@yahoo.com> parents: 51879 diff changeset	303 ) -> int:
45957 89a2afe31e82 formating: upgrade to black 20.8b1 Augie Fackler <raf@durin42.com> parents: 45084 diff changeset	304 """create archive of repo as it was at node.
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	305
51879 3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	306 dest can be name of directory, name of archive file, a callable, or file
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	307 object to write archive to. If it is a callable, it will called to open
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	308 the actual file object before the first archive member is written.
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	309
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	310 kind is type of archive to create.
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	311
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	312 decode tells whether to put files through decode filters from
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	313 hgrc.
2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	314
40483 3d76a8e627a6 archive: change "matcnfn" argument to a real matcher Martin von Zweigbergk <martinvonz@google.com> parents: 40247 diff changeset	315 match is a matcher to filter names of files to write to archive.
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	316
35212 760fef6aca74 archive: pass thru mtime for directory archives, like other archive types do James May <james.may@draeger.com> parents: 33545 diff changeset	317 prefix is name of path to put before every archive member.
760fef6aca74 archive: pass thru mtime for directory archives, like other archive types do James May <james.may@draeger.com> parents: 33545 diff changeset	318
760fef6aca74 archive: pass thru mtime for directory archives, like other archive types do James May <james.may@draeger.com> parents: 33545 diff changeset	319 mtime is the modified time, in seconds, or None to use the changeset time.
760fef6aca74 archive: pass thru mtime for directory archives, like other archive types do James May <james.may@draeger.com> parents: 33545 diff changeset	320
760fef6aca74 archive: pass thru mtime for directory archives, like other archive types do James May <james.may@draeger.com> parents: 33545 diff changeset	321 subrepos tells whether to include subrepos.
45957 89a2afe31e82 formating: upgrade to black 20.8b1 Augie Fackler <raf@durin42.com> parents: 45084 diff changeset	322 """
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	323
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	324 if kind == b'files':
11558 d8f6458434ec archival: remove prefix argument from archivers Martin Geisler <mg@lazybytes.net> parents: 11557 diff changeset	325 if prefix:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	326 raise error.Abort(_(b'cannot give prefix when archiving to files'))
11558 d8f6458434ec archival: remove prefix argument from archivers Martin Geisler <mg@lazybytes.net> parents: 11557 diff changeset	327 else:
d8f6458434ec archival: remove prefix argument from archivers Martin Geisler <mg@lazybytes.net> parents: 11557 diff changeset	328 prefix = tidyprefix(dest, kind, prefix)
d8f6458434ec archival: remove prefix argument from archivers Martin Geisler <mg@lazybytes.net> parents: 11557 diff changeset	329
51879 3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	330 archiver = None
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	331 ctx = repo[node]
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	332
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	333 def opencallback():
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	334 """Return the archiver instance, creating it if necessary.
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	335
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	336 This function is called when the first actual entry is created.
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	337 It may be called multiple times from different layers.
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	338 When serving the archive via hgweb, no errors should happen after
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	339 this point.
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	340 """
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	341 nonlocal archiver
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	342 if archiver is None:
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	343 if callable(dest):
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	344 output = dest()
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	345 else:
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	346 output = dest
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	347 archiver = archivers[kind](output, mtime or ctx.date()[0])
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	348 assert archiver is not None
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	349
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	350 if repo.ui.configbool(b"ui", b"archivemeta"):
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	351 metaname = b'.hg_archival.txt'
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	352 if match(metaname):
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	353 write(metaname, 0o644, False, lambda: buildmetadata(ctx))
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	354 return archiver
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	355
4951 667290b6c95e archive: delay extraction of file revisions Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4831 diff changeset	356 def write(name, mode, islink, getdata):
51879 3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	357 if archiver is None:
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	358 opencallback()
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	359 assert archiver is not None, "archive should be opened by now"
3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	360
4951 667290b6c95e archive: delay extraction of file revisions Alexis S. L. Carvalho <alexis@cecm.usp.br> parents: 4831 diff changeset	361 data = getdata()
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	362 if decode:
4005 656e06eebda7 replace filehandle version of wwrite with wwritedata Matt Mackall <mpm@selenic.com> parents: 3968 diff changeset	363 data = repo.wwritedata(name, data)
11558 d8f6458434ec archival: remove prefix argument from archivers Martin Geisler <mg@lazybytes.net> parents: 11557 diff changeset	364 archiver.addfile(prefix + name, mode, islink, data)
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	365
6019 b70a530bdb93 cleanly abort on unknown archive type (issue966) Dirkjan Ochtman <dirkjan@ochtman.nl> parents: 4951 diff changeset	366 if kind not in archivers:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	367 raise error.Abort(_(b"unknown archive type '%s'") % kind)
6749 51b0e799352f manifest: remove execf/linkf methods Matt Mackall <mpm@selenic.com> parents: 6747 diff changeset	368
40484 997997eb8367 archive: create alwaysmatcher when no matcher provided Martin von Zweigbergk <martinvonz@google.com> parents: 40483 diff changeset	369 if not match:
997997eb8367 archive: create alwaysmatcher when no matcher provided Martin von Zweigbergk <martinvonz@google.com> parents: 40483 diff changeset	370 match = scmutil.matchall(repo)
997997eb8367 archive: create alwaysmatcher when no matcher provided Martin von Zweigbergk <martinvonz@google.com> parents: 40483 diff changeset	371
44330 e786d69c665d archival: use walk() instead of matches() on manifest Augie Fackler <augie@google.com> parents: 43554 diff changeset	372 files = list(ctx.manifest().walk(match))
16919 51932c835b74 archive: make progress only show files that are actually archived Thomas Arendsen Hein <thomas@intevation.de> parents: 15057 diff changeset	373 total = len(files)
18967 88d1b59f6906 archive: raise error.Abort if the file pattern matches no files Angel Ezquerra <angel.ezquerra@gmail.com> parents: 18364 diff changeset	374 if total:
88d1b59f6906 archive: raise error.Abort if the file pattern matches no files Angel Ezquerra <angel.ezquerra@gmail.com> parents: 18364 diff changeset	375 files.sort()
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	376 scmutil.prefetchfiles(
45073 a56ba57c837d scmutil: allowing different files to be prefetched per revision Rodrigo Damazio Bovendorp <rdamazio@google.com> parents: 44586 diff changeset	377 repo, [(ctx.rev(), scmutil.matchfiles(repo, files))]
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	378 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	379 progress = repo.ui.makeprogress(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	380 _(b'archiving'), unit=_(b'files'), total=total
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42944 diff changeset	381 )
38387 1a2ff11e8a88 archival: use progress helper Martin von Zweigbergk <martinvonz@google.com> parents: 37762 diff changeset	382 progress.update(0)
1a2ff11e8a88 archival: use progress helper Martin von Zweigbergk <martinvonz@google.com> parents: 37762 diff changeset	383 for f in files:
18967 88d1b59f6906 archive: raise error.Abort if the file pattern matches no files Angel Ezquerra <angel.ezquerra@gmail.com> parents: 18364 diff changeset	384 ff = ctx.flags(f)
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	385 write(f, b'x' in ff and 0o755 or 0o644, b'l' in ff, ctx[f].data)
38387 1a2ff11e8a88 archival: use progress helper Martin von Zweigbergk <martinvonz@google.com> parents: 37762 diff changeset	386 progress.increment(item=f)
1a2ff11e8a88 archival: use progress helper Martin von Zweigbergk <martinvonz@google.com> parents: 37762 diff changeset	387 progress.complete()
12323 f00953d9533c subrepo: add support for 'hg archive' Martin Geisler <mg@aragost.com> parents: 12321 diff changeset	388
f00953d9533c subrepo: add support for 'hg archive' Martin Geisler <mg@aragost.com> parents: 12321 diff changeset	389 if subrepos:
18364 6252b4f1c4b4 subrepos: process subrepos in sorted order Mads Kiilerich <mads@kiilerich.com> parents: 18344 diff changeset	390 for subpath in sorted(ctx.substate):
25601 3ec8351fa6ed archive: support 'wdir()' Matt Harbison <matt_harbison@yahoo.com> parents: 25149 diff changeset	391 sub = ctx.workingsub(subpath)
40483 3d76a8e627a6 archive: change "matcnfn" argument to a real matcher Martin von Zweigbergk <martinvonz@google.com> parents: 40247 diff changeset	392 submatch = matchmod.subdirmatcher(subpath, match)
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	393 subprefix = prefix + subpath + b'/'
51879 3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	394 total += sub.archive(opencallback, subprefix, submatch, decode)
18967 88d1b59f6906 archive: raise error.Abort if the file pattern matches no files Angel Ezquerra <angel.ezquerra@gmail.com> parents: 18364 diff changeset	395
88d1b59f6906 archive: raise error.Abort if the file pattern matches no files Angel Ezquerra <angel.ezquerra@gmail.com> parents: 18364 diff changeset	396 if total == 0:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	397 raise error.Abort(_(b'no files match the archive pattern'))
12323 f00953d9533c subrepo: add support for 'hg archive' Martin Geisler <mg@aragost.com> parents: 12321 diff changeset	398
51879 3b8d92f71d92 archive: defer opening the output until a file is matched Joerg Sonnenberger <joerg@bec.de> parents: 49898 diff changeset	399 assert archiver is not None, "archive should have been opened before"
2112 2b03c6733efa add "archive" command, like "cvs export" only better. Vadim Gelfer <vadim.gelfer@gmail.com> parents: diff changeset	400 archiver.done()
18967 88d1b59f6906 archive: raise error.Abort if the file pattern matches no files Angel Ezquerra <angel.ezquerra@gmail.com> parents: 18364 diff changeset	401 return total

Mercurial > public > mercurial-scm > hg-stable

annotate mercurial/archival.py @ 51897:b60f25f00e94