mercurial-scm/hg: hgext/sqlitestore.py annotate

annotate hgext/sqlitestore.py @ 51725:278af66e6595

typing: induce pytype to use the standard `attr` instead of the vendored copy What was previously happening with the vendored copy was that pytype would stub out all(?) classes that were decorated with `@attr.s` as `Any`. After this, we get a ton of classes defined, and numerous fields and methods now have proper types.

author	Matt Harbison <matt_harbison@yahoo.com>
date	Tue, 23 Jul 2024 19:20:22 -0400
parents	ca7bde5dbafb
children	f4733654f144

rev	line source
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1 # sqlitestore.py - Storage backend that uses SQLite
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	2 #
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	3 # Copyright 2018 Gregory Szorc <gregory.szorc@gmail.com>
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	4 #
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	5 # This software may be used and distributed according to the terms of the
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	6 # GNU General Public License version 2 or any later version.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	7
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	8 """store repository data in SQLite (EXPERIMENTAL)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	9
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	10 The sqlitestore extension enables the storage of repository data in SQLite.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	11
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	12 This extension is HIGHLY EXPERIMENTAL. There are NO BACKWARDS COMPATIBILITY
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	13 GUARANTEES. This means that repositories created with this extension may
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	14 only be usable with the exact version of this extension/Mercurial that was
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	15 used. The extension attempts to enforce this in order to prevent repository
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	16 corruption.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	17
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	18 In addition, several features are not yet supported or have known bugs:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	19
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	20 * Only some data is stored in SQLite. Changeset, manifest, and other repository
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	21 data is not yet stored in SQLite.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	22 * Transactions are not robust. If the process is aborted at the right time
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	23 during transaction close/rollback, the repository could be in an inconsistent
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	24 state. This problem will diminish once all repository data is tracked by
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	25 SQLite.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	26 * Bundle repositories do not work (the ability to use e.g.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	27 `hg -R <bundle-file> log` to automatically overlay a bundle on top of the
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	28 existing repository).
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	29 * Various other features don't work.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	30
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	31 This extension should work for basic clone/pull, update, and commit workflows.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	32 Some history rewriting operations may fail due to lack of support for bundle
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	33 repositories.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	34
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	35 To use, activate the extension and set the ``storage.new-repo-backend`` config
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	36 option to ``sqlite`` to enable new repositories to use SQLite for storage.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	37 """
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	38
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	39 # To run the test suite with repos using SQLite by default, execute the
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	40 # following:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	41 #
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	42 # HGREPOFEATURES="sqlitestore" run-tests.py \
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	43 # --extra-config-opt extensions.sqlitestore= \
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	44 # --extra-config-opt storage.new-repo-backend=sqlite
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	45
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	46
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	47 import sqlite3
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	48 import struct
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	49 import threading
51725 278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	50 import typing
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	51 import zlib
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	52
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	53 from mercurial.i18n import _
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	54 from mercurial.node import (
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	55 nullrev,
46780 6266d19556ad node: introduce nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46715 diff changeset	56 sha1nodeconstants,
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	57 short,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	58 )
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	59 from mercurial.thirdparty import attr
51725 278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	60
278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	61 # Force pytype to use the non-vendored package
278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	62 if typing.TYPE_CHECKING:
278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	63 # noinspection PyPackageRequirements
278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	64 import attr
278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	65
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	66 from mercurial import (
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	67 ancestor,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	68 dagop,
40410 3b782669561d py3: make sure we pass sysstr in sqlite3.connect() Pulkit Goyal <pulkit@yandex-team.ru> parents: 40392 diff changeset	69 encoding,
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	70 error,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	71 extensions,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	72 localrepo,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	73 mdiff,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	74 pycompat,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	75 registrar,
45372 77b8588dd84e requirements: introduce new requirements related module Pulkit Goyal <7895pulkit@gmail.com> parents: 44062 diff changeset	76 requirements,
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	77 util,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	78 verify,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	79 )
42813 268662aac075 interfaces: create a new folder for interfaces and move repository.py in it Pulkit Goyal <pulkit@yandex-team.ru> parents: 42772 diff changeset	80 from mercurial.interfaces import (
268662aac075 interfaces: create a new folder for interfaces and move repository.py in it Pulkit Goyal <pulkit@yandex-team.ru> parents: 42772 diff changeset	81 repository,
42814 2c4f656c8e9f interfaceutil: move to interfaces/ Pulkit Goyal <pulkit@yandex-team.ru> parents: 42813 diff changeset	82 util as interfaceutil,
42813 268662aac075 interfaces: create a new folder for interfaces and move repository.py in it Pulkit Goyal <pulkit@yandex-team.ru> parents: 42772 diff changeset	83 )
44062 2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	84 from mercurial.utils import (
2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	85 hashutil,
2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	86 storageutil,
2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	87 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	88
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	89 try:
49849 de9ffb82ef4d typing: suppress a bunch of potential import-error cases in extensions Matt Harbison <matt_harbison@yahoo.com> parents: 49845 diff changeset	90 from mercurial import zstd # pytype: disable=import-error
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	91
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	92 zstd.__version__
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	93 except ImportError:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	94 zstd = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	95
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	96 configtable = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	97 configitem = registrar.configitem(configtable)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	98
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	99 # experimental config: storage.sqlite.compression
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	100 configitem(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	101 b'storage',
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	102 b'sqlite.compression',
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	103 default=b'zstd' if zstd else b'zlib',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	104 experimental=True,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	105 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	106
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	107 # Note for extension authors: ONLY specify testedwith = 'ships-with-hg-core' for
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	108 # extensions which SHIP WITH MERCURIAL. Non-mainline extensions should
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	109 # be specifying the version(s) of Mercurial they are tested with, or
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	110 # leave the attribute unspecified.
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	111 testedwith = b'ships-with-hg-core'
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	112
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	113 REQUIREMENT = b'exp-sqlite-001'
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	114 REQUIREMENT_ZSTD = b'exp-sqlite-comp-001=zstd'
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	115 REQUIREMENT_ZLIB = b'exp-sqlite-comp-001=zlib'
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	116 REQUIREMENT_NONE = b'exp-sqlite-comp-001=none'
40390 7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	117 REQUIREMENT_SHALLOW_FILES = b'exp-sqlite-shallow-files'
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	118
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	119 CURRENT_SCHEMA_VERSION = 1
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	120
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	121 COMPRESSION_NONE = 1
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	122 COMPRESSION_ZSTD = 2
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	123 COMPRESSION_ZLIB = 3
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	124
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	125 FLAG_CENSORED = 1
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	126 FLAG_MISSING_P1 = 2
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	127 FLAG_MISSING_P2 = 4
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	128
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	129 CREATE_SCHEMA = [
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	130 # Deltas are stored as content-indexed blobs.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	131 # compression column holds COMPRESSION_* constant for how the
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	132 # delta is encoded.
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	133 'CREATE TABLE delta ('
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	134 ' id INTEGER PRIMARY KEY, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	135 ' compression INTEGER NOT NULL, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	136 ' hash BLOB UNIQUE ON CONFLICT ABORT, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	137 ' delta BLOB NOT NULL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	138 ')',
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	139 # Tracked paths are denormalized to integers to avoid redundant
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	140 # storage of the path name.
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	141 'CREATE TABLE filepath ('
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	142 ' id INTEGER PRIMARY KEY, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	143 ' path BLOB NOT NULL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	144 ')',
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	145 'CREATE UNIQUE INDEX filepath_path ON filepath (path)',
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	146 # We have a single table for all file revision data.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	147 # Each file revision is uniquely described by a (path, rev) and
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	148 # (path, node).
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	149 #
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	150 # Revision data is stored as a pointer to the delta producing this
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	151 # revision and the file revision whose delta should be applied before
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	152 # that one. One can reconstruct the delta chain by recursively following
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	153 # the delta base revision pointers until one encounters NULL.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	154 #
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	155 # flags column holds bitwise integer flags controlling storage options.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	156 # These flags are defined by the FLAG_* constants.
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	157 'CREATE TABLE fileindex ('
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	158 ' id INTEGER PRIMARY KEY, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	159 ' pathid INTEGER REFERENCES filepath(id), '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	160 ' revnum INTEGER NOT NULL, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	161 ' p1rev INTEGER NOT NULL, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	162 ' p2rev INTEGER NOT NULL, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	163 ' linkrev INTEGER NOT NULL, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	164 ' flags INTEGER NOT NULL, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	165 ' deltaid INTEGER REFERENCES delta(id), '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	166 ' deltabaseid INTEGER REFERENCES fileindex(id), '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	167 ' node BLOB NOT NULL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	168 ')',
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	169 'CREATE UNIQUE INDEX fileindex_pathrevnum '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	170 ' ON fileindex (pathid, revnum)',
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	171 'CREATE UNIQUE INDEX fileindex_pathnode ON fileindex (pathid, node)',
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	172 # Provide a view over all file data for convenience.
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	173 'CREATE VIEW filedata AS '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	174 'SELECT '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	175 ' fileindex.id AS id, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	176 ' filepath.id AS pathid, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	177 ' filepath.path AS path, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	178 ' fileindex.revnum AS revnum, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	179 ' fileindex.node AS node, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	180 ' fileindex.p1rev AS p1rev, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	181 ' fileindex.p2rev AS p2rev, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	182 ' fileindex.linkrev AS linkrev, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	183 ' fileindex.flags AS flags, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	184 ' fileindex.deltaid AS deltaid, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	185 ' fileindex.deltabaseid AS deltabaseid '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	186 'FROM filepath, fileindex '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	187 'WHERE fileindex.pathid=filepath.id',
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	188 'PRAGMA user_version=%d' % CURRENT_SCHEMA_VERSION,
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	189 ]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	190
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	191
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	192 def resolvedeltachain(db, pathid, node, revisioncache, stoprids, zstddctx=None):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	193 """Resolve a delta chain for a file node."""
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	194
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	195 # TODO the "not in ({stops})" here is possibly slowing down the query
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	196 # because it needs to perform the lookup on every recursive invocation.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	197 # This could possibly be faster if we created a temporary query with
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	198 # baseid "poisoned" to null and limited the recursive filter to
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	199 # "is not null".
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	200 res = db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	201 'WITH RECURSIVE '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	202 ' deltachain(deltaid, baseid) AS ('
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	203 ' SELECT deltaid, deltabaseid FROM fileindex '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	204 ' WHERE pathid=? AND node=? '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	205 ' UNION ALL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	206 ' SELECT fileindex.deltaid, deltabaseid '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	207 ' FROM fileindex, deltachain '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	208 ' WHERE '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	209 ' fileindex.id=deltachain.baseid '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	210 ' AND deltachain.baseid IS NOT NULL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	211 ' AND fileindex.id NOT IN ({stops}) '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	212 ' ) '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	213 'SELECT deltachain.baseid, compression, delta '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	214 'FROM deltachain, delta '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	215 'WHERE delta.id=deltachain.deltaid'.format(
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	216 stops=','.join(['?'] * len(stoprids))
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	217 ),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	218 tuple([pathid, node] + list(stoprids.keys())),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	219 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	220
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	221 deltas = []
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	222 lastdeltabaseid = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	223
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	224 for deltabaseid, compression, delta in res:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	225 lastdeltabaseid = deltabaseid
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	226
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	227 if compression == COMPRESSION_ZSTD:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	228 delta = zstddctx.decompress(delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	229 elif compression == COMPRESSION_NONE:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	230 delta = delta
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	231 elif compression == COMPRESSION_ZLIB:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	232 delta = zlib.decompress(delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	233 else:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	234 raise SQLiteStoreError(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	235 b'unhandled compression type: %d' % compression
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	236 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	237
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	238 deltas.append(delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	239
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	240 if lastdeltabaseid in stoprids:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	241 basetext = revisioncache[stoprids[lastdeltabaseid]]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	242 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	243 basetext = deltas.pop()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	244
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	245 deltas.reverse()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	246 fulltext = mdiff.patches(basetext, deltas)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	247
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	248 # SQLite returns buffer instances for blob columns on Python 2. This
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	249 # type can propagate through the delta application layer. Because
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	250 # downstream callers assume revisions are bytes, cast as needed.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	251 if not isinstance(fulltext, bytes):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	252 fulltext = bytes(delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	253
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	254 return fulltext
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	255
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	256
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	257 def insertdelta(db, compression, hash, delta):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	258 try:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	259 return db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	260 'INSERT INTO delta (compression, hash, delta) VALUES (?, ?, ?)',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	261 (compression, hash, delta),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	262 ).lastrowid
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	263 except sqlite3.IntegrityError:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	264 return db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	265 'SELECT id FROM delta WHERE hash=?', (hash,)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	266 ).fetchone()[0]
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	267
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	268
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	269 class SQLiteStoreError(error.StorageError):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	270 pass
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	271
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	272
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	273 @attr.s
48946 642e31cb55f0 py3: use class X: instead of class X(object): Gregory Szorc <gregory.szorc@gmail.com> parents: 48875 diff changeset	274 class revisionentry:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	275 rid = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	276 rev = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	277 node = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	278 p1rev = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	279 p2rev = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	280 p1node = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	281 p2node = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	282 linkrev = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	283 flags = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	284
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	285
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	286 @interfaceutil.implementer(repository.irevisiondelta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	287 @attr.s(slots=True)
48946 642e31cb55f0 py3: use class X: instead of class X(object): Gregory Szorc <gregory.szorc@gmail.com> parents: 48875 diff changeset	288 class sqliterevisiondelta:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	289 node = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	290 p1node = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	291 p2node = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	292 basenode = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	293 flags = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	294 baserevisionsize = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	295 revision = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	296 delta = attr.ib()
46712 e8c11a2c96c0 delta: add sidedata field to revision delta Rapha?l Gom?s <rgomes@octobus.net> parents: 46711 diff changeset	297 sidedata = attr.ib()
47077 119790e1c67c cg4: introduce protocol flag to signify the presence of sidedata Rapha?l Gom?s <rgomes@octobus.net> parents: 47012 diff changeset	298 protocol_flags = attr.ib()
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	299 linknode = attr.ib(default=None)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	300
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	301
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	302 @interfaceutil.implementer(repository.iverifyproblem)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	303 @attr.s(frozen=True)
48946 642e31cb55f0 py3: use class X: instead of class X(object): Gregory Szorc <gregory.szorc@gmail.com> parents: 48875 diff changeset	304 class sqliteproblem:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	305 warning = attr.ib(default=None)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	306 error = attr.ib(default=None)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	307 node = attr.ib(default=None)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	308
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	309
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	310 @interfaceutil.implementer(repository.ifilestorage)
48946 642e31cb55f0 py3: use class X: instead of class X(object): Gregory Szorc <gregory.szorc@gmail.com> parents: 48875 diff changeset	311 class sqlitefilestore:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	312 """Implements storage for an individual tracked path."""
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	313
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	314 def __init__(self, db, path, compression):
46780 6266d19556ad node: introduce nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46715 diff changeset	315 self.nullid = sha1nodeconstants.nullid
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	316 self._db = db
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	317 self._path = path
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	318
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	319 self._pathid = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	320
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	321 # revnum -> node
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	322 self._revtonode = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	323 # node -> revnum
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	324 self._nodetorev = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	325 # node -> data structure
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	326 self._revisions = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	327
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	328 self._revisioncache = util.lrucachedict(10)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	329
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	330 self._compengine = compression
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	331
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	332 if compression == b'zstd':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	333 self._cctx = zstd.ZstdCompressor(level=3)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	334 self._dctx = zstd.ZstdDecompressor()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	335 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	336 self._cctx = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	337 self._dctx = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	338
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	339 self._refreshindex()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	340
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	341 def _refreshindex(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	342 self._revtonode = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	343 self._nodetorev = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	344 self._revisions = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	345
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	346 res = list(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	347 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	348 'SELECT id FROM filepath WHERE path=?', (self._path,)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	349 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	350 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	351
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	352 if not res:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	353 self._pathid = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	354 return
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	355
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	356 self._pathid = res[0][0]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	357
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	358 res = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	359 'SELECT id, revnum, node, p1rev, p2rev, linkrev, flags '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	360 'FROM fileindex '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	361 'WHERE pathid=? '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	362 'ORDER BY revnum ASC',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	363 (self._pathid,),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	364 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	365
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	366 for i, row in enumerate(res):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	367 rid, rev, node, p1rev, p2rev, linkrev, flags = row
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	368
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	369 if i != rev:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	370 raise SQLiteStoreError(
43117 8ff1ecfadcd1 cleanup: join string literals that are already on one line Martin von Zweigbergk <martinvonz@google.com> parents: 43077 diff changeset	371 _(b'sqlite database has inconsistent revision numbers')
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	372 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	373
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	374 if p1rev == nullrev:
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	375 p1node = sha1nodeconstants.nullid
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	376 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	377 p1node = self._revtonode[p1rev]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	378
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	379 if p2rev == nullrev:
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	380 p2node = sha1nodeconstants.nullid
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	381 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	382 p2node = self._revtonode[p2rev]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	383
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	384 entry = revisionentry(
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	385 rid=rid,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	386 rev=rev,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	387 node=node,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	388 p1rev=p1rev,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	389 p2rev=p2rev,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	390 p1node=p1node,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	391 p2node=p2node,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	392 linkrev=linkrev,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	393 flags=flags,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	394 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	395
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	396 self._revtonode[rev] = node
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	397 self._nodetorev[node] = rev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	398 self._revisions[node] = entry
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	399
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	400 # Start of ifileindex interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	401
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	402 def __len__(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	403 return len(self._revisions)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	404
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	405 def __iter__(self):
49284 d44e3c45f0e4 py3: replace `pycompat.xrange` by `range` Manuel Jacob <me@manueljacob.de> parents: 48946 diff changeset	406 return iter(range(len(self._revisions)))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	407
40387 f1a39128da95 filelog: add a hasnode() method (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 40326 diff changeset	408 def hasnode(self, node):
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	409 if node == sha1nodeconstants.nullid:
40387 f1a39128da95 filelog: add a hasnode() method (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 40326 diff changeset	410 return False
f1a39128da95 filelog: add a hasnode() method (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 40326 diff changeset	411
f1a39128da95 filelog: add a hasnode() method (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 40326 diff changeset	412 return node in self._nodetorev
f1a39128da95 filelog: add a hasnode() method (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 40326 diff changeset	413
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	414 def revs(self, start=0, stop=None):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	415 return storageutil.iterrevs(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	416 len(self._revisions), start=start, stop=stop
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	417 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	418
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	419 def parents(self, node):
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	420 if node == sha1nodeconstants.nullid:
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	421 return sha1nodeconstants.nullid, sha1nodeconstants.nullid
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	422
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	423 if node not in self._revisions:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	424 raise error.LookupError(node, self._path, _(b'no node'))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	425
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	426 entry = self._revisions[node]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	427 return entry.p1node, entry.p2node
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	428
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	429 def parentrevs(self, rev):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	430 if rev == nullrev:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	431 return nullrev, nullrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	432
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	433 if rev not in self._revtonode:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	434 raise IndexError(rev)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	435
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	436 entry = self._revisions[self._revtonode[rev]]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	437 return entry.p1rev, entry.p2rev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	438
49789 df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	439 def ancestors(self, revs, stoprev=0, inclusive=False):
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	440 """Generate the ancestors of 'revs' in reverse revision order.
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	441 Does not generate revs lower than stoprev.
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	442
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	443 See the documentation for ancestor.lazyancestors for more details."""
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	444
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	445 # first, make sure start revisions aren't filtered
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	446 revs = list(revs)
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	447 checkrev = self.node
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	448 for r in revs:
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	449 checkrev(r)
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	450
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	451 return ancestor.lazyancestors(
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	452 self.parentrevs,
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	453 revs,
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	454 stoprev=stoprev,
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	455 inclusive=inclusive,
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	456 )
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	457
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	458 def rev(self, node):
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	459 if node == sha1nodeconstants.nullid:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	460 return nullrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	461
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	462 if node not in self._nodetorev:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	463 raise error.LookupError(node, self._path, _(b'no node'))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	464
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	465 return self._nodetorev[node]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	466
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	467 def node(self, rev):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	468 if rev == nullrev:
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	469 return sha1nodeconstants.nullid
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	470
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	471 if rev not in self._revtonode:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	472 raise IndexError(rev)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	473
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	474 return self._revtonode[rev]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	475
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	476 def lookup(self, node):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	477 return storageutil.fileidlookup(self, node, self._path)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	478
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	479 def linkrev(self, rev):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	480 if rev == nullrev:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	481 return nullrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	482
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	483 if rev not in self._revtonode:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	484 raise IndexError(rev)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	485
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	486 entry = self._revisions[self._revtonode[rev]]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	487 return entry.linkrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	488
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	489 def iscensored(self, rev):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	490 if rev == nullrev:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	491 return False
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	492
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	493 if rev not in self._revtonode:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	494 raise IndexError(rev)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	495
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	496 return self._revisions[self._revtonode[rev]].flags & FLAG_CENSORED
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	497
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	498 def commonancestorsheads(self, node1, node2):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	499 rev1 = self.rev(node1)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	500 rev2 = self.rev(node2)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	501
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	502 ancestors = ancestor.commonancestorsheads(self.parentrevs, rev1, rev2)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	503 return pycompat.maplist(self.node, ancestors)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	504
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	505 def descendants(self, revs):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	506 # TODO we could implement this using a recursive SQL query, which
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	507 # might be faster.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	508 return dagop.descendantrevs(revs, self.revs, self.parentrevs)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	509
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	510 def heads(self, start=None, stop=None):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	511 if start is None and stop is None:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	512 if not len(self):
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	513 return [sha1nodeconstants.nullid]
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	514
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	515 startrev = self.rev(start) if start is not None else nullrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	516 stoprevs = {self.rev(n) for n in stop or []}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	517
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	518 revs = dagop.headrevssubset(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	519 self.revs, self.parentrevs, startrev=startrev, stoprevs=stoprevs
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	520 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	521
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	522 return [self.node(rev) for rev in revs]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	523
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	524 def children(self, node):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	525 rev = self.rev(node)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	526
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	527 res = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	528 'SELECT'
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	529 ' node '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	530 ' FROM filedata '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	531 ' WHERE path=? AND (p1rev=? OR p2rev=?) '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	532 ' ORDER BY revnum ASC',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	533 (self._path, rev, rev),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	534 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	535
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	536 return [row[0] for row in res]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	537
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	538 # End of ifileindex interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	539
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	540 # Start of ifiledata interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	541
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	542 def size(self, rev):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	543 if rev == nullrev:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	544 return 0
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	545
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	546 if rev not in self._revtonode:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	547 raise IndexError(rev)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	548
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	549 node = self._revtonode[rev]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	550
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	551 if self.renamed(node):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	552 return len(self.read(node))
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	553
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	554 return len(self.revision(node))
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	555
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	556 def revision(self, node, raw=False, _verifyhash=True):
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	557 if node in (sha1nodeconstants.nullid, nullrev):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	558 return b''
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	559
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	560 if isinstance(node, int):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	561 node = self.node(node)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	562
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	563 if node not in self._nodetorev:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	564 raise error.LookupError(node, self._path, _(b'no node'))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	565
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	566 if node in self._revisioncache:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	567 return self._revisioncache[node]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	568
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	569 # Because we have a fulltext revision cache, we are able to
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	570 # short-circuit delta chain traversal and decompression as soon as
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	571 # we encounter a revision in the cache.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	572
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	573 stoprids = {self._revisions[n].rid: n for n in self._revisioncache}
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	574
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	575 if not stoprids:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	576 stoprids[-1] = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	577
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	578 fulltext = resolvedeltachain(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	579 self._db,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	580 self._pathid,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	581 node,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	582 self._revisioncache,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	583 stoprids,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	584 zstddctx=self._dctx,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	585 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	586
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	587 # Don't verify hashes if parent nodes were rewritten, as the hash
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	588 # wouldn't verify.
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	589 if self._revisions[node].flags & (FLAG_MISSING_P1 \| FLAG_MISSING_P2):
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	590 _verifyhash = False
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	591
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	592 if _verifyhash:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	593 self._checkhash(fulltext, node)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	594 self._revisioncache[node] = fulltext
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	595
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	596 return fulltext
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	597
42722 c9f3f4c8999a rawdata: implement `rawdata` for `sqlitestore` too Pierre-Yves David <pierre-yves.david@octobus.net> parents: 40460 diff changeset	598 def rawdata(self, args, *kwargs):
c9f3f4c8999a rawdata: implement `rawdata` for `sqlitestore` too Pierre-Yves David <pierre-yves.david@octobus.net> parents: 40460 diff changeset	599 return self.revision(args, *kwargs)
c9f3f4c8999a rawdata: implement `rawdata` for `sqlitestore` too Pierre-Yves David <pierre-yves.david@octobus.net> parents: 40460 diff changeset	600
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	601 def read(self, node):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	602 return storageutil.filtermetadata(self.revision(node))
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	603
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	604 def renamed(self, node):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	605 return storageutil.filerevisioncopied(self, node)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	606
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	607 def cmp(self, node, fulltext):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	608 return not storageutil.filedataequivalent(self, node, fulltext)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	609
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	610 def emitrevisions(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	611 self,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	612 nodes,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	613 nodesorder=None,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	614 revisiondata=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	615 assumehaveparentrevisions=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	616 deltamode=repository.CG_DELTAMODE_STD,
46715 45f0d5297698 changegroupv4: add sidedata helpers Rapha?l Gom?s <rgomes@octobus.net> parents: 46712 diff changeset	617 sidedata_helpers=None,
49609 9cac281eb9c0 debug: add an option to display statistic about a bundling operation Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	618 debug_info=None,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	619 ):
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	620 if nodesorder not in (b'nodes', b'storage', b'linear', None):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	621 raise error.ProgrammingError(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	622 b'unhandled value for nodesorder: %s' % nodesorder
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	623 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	624
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	625 nodes = [n for n in nodes if n != sha1nodeconstants.nullid]
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	626
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	627 if not nodes:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	628 return
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	629
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	630 # TODO perform in a single query.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	631 res = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	632 'SELECT revnum, deltaid FROM fileindex '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	633 'WHERE pathid=? '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	634 ' AND node in (%s)' % (','.join(['?'] * len(nodes))),
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	635 tuple([self._pathid] + nodes),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	636 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	637
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	638 deltabases = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	639
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	640 for rev, deltaid in res:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	641 res = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	642 'SELECT revnum from fileindex WHERE pathid=? AND deltaid=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	643 (self._pathid, deltaid),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	644 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	645 deltabases[rev] = res.fetchone()[0]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	646
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	647 # TODO define revdifffn so we can use delta from storage.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	648 for delta in storageutil.emitrevisions(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	649 self,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	650 nodes,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	651 nodesorder,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	652 sqliterevisiondelta,
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	653 deltaparentfn=deltabases.__getitem__,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	654 revisiondata=revisiondata,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	655 assumehaveparentrevisions=assumehaveparentrevisions,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	656 deltamode=deltamode,
46715 45f0d5297698 changegroupv4: add sidedata helpers Rapha?l Gom?s <rgomes@octobus.net> parents: 46712 diff changeset	657 sidedata_helpers=sidedata_helpers,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	658 ):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	659 yield delta
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	660
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	661 # End of ifiledata interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	662
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	663 # Start of ifilemutation interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	664
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	665 def add(self, filedata, meta, transaction, linkrev, p1, p2):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	666 if meta or filedata.startswith(b'\x01\n'):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	667 filedata = storageutil.packmeta(meta, filedata)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	668
46508 f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	669 rev = self.addrevision(filedata, transaction, linkrev, p1, p2)
f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	670 return self.node(rev)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	671
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	672 def addrevision(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	673 self,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	674 revisiondata,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	675 transaction,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	676 linkrev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	677 p1,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	678 p2,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	679 node=None,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	680 flags=0,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	681 cachedelta=None,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	682 ):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	683 if flags:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	684 raise SQLiteStoreError(_(b'flags not supported on revisions'))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	685
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	686 validatehash = node is not None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	687 node = node or storageutil.hashrevisionsha1(revisiondata, p1, p2)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	688
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	689 if validatehash:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	690 self._checkhash(revisiondata, node, p1, p2)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	691
46508 f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	692 rev = self._nodetorev.get(node)
f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	693 if rev is not None:
f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	694 return rev
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	695
46508 f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	696 rev = self._addrawrevision(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	697 node, revisiondata, transaction, linkrev, p1, p2
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	698 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	699
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	700 self._revisioncache[node] = revisiondata
46508 f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	701 return rev
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	702
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	703 def addgroup(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	704 self,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	705 deltas,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	706 linkmapper,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	707 transaction,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	708 addrevisioncb=None,
45788 a5206e71c536 revlog: extend addgroup() with callback for duplicates Joerg Sonnenberger <joerg@bec.de> parents: 45372 diff changeset	709 duplicaterevisioncb=None,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	710 maybemissingparents=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	711 ):
45788 a5206e71c536 revlog: extend addgroup() with callback for duplicates Joerg Sonnenberger <joerg@bec.de> parents: 45372 diff changeset	712 empty = True
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	713
46711 a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	714 for (
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	715 node,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	716 p1,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	717 p2,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	718 linknode,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	719 deltabase,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	720 delta,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	721 wireflags,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	722 sidedata,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	723 ) in deltas:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	724 storeflags = 0
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	725
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	726 if wireflags & repository.REVISION_FLAG_CENSORED:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	727 storeflags \|= FLAG_CENSORED
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	728
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	729 if wireflags & ~repository.REVISION_FLAG_CENSORED:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	730 raise SQLiteStoreError(b'unhandled revision flag')
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	731
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	732 if maybemissingparents:
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	733 if p1 != sha1nodeconstants.nullid and not self.hasnode(p1):
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	734 p1 = sha1nodeconstants.nullid
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	735 storeflags \|= FLAG_MISSING_P1
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	736
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	737 if p2 != sha1nodeconstants.nullid and not self.hasnode(p2):
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	738 p2 = sha1nodeconstants.nullid
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	739 storeflags \|= FLAG_MISSING_P2
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	740
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	741 baserev = self.rev(deltabase)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	742
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	743 # If base is censored, delta must be full replacement in a single
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	744 # patch operation.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	745 if baserev != nullrev and self.iscensored(baserev):
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	746 hlen = struct.calcsize(b'>lll')
42772 5c2e8a661418 rawdata: update callers in sqlitestore Pierre-Yves David <pierre-yves.david@octobus.net> parents: 42760 diff changeset	747 oldlen = len(self.rawdata(deltabase, _verifyhash=False))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	748 newlen = len(delta) - hlen
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	749
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	750 if delta[:hlen] != mdiff.replacediffheader(oldlen, newlen):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	751 raise error.CensoredBaseError(self._path, deltabase)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	752
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	753 if not (storeflags & FLAG_CENSORED) and storageutil.deltaiscensored(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	754 delta, baserev, lambda x: len(self.rawdata(x))
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	755 ):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	756 storeflags \|= FLAG_CENSORED
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	757
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	758 linkrev = linkmapper(linknode)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	759
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	760 if node in self._revisions:
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	761 # Possibly reset parents to make them proper.
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	762 entry = self._revisions[node]
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	763
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	764 if (
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	765 entry.flags & FLAG_MISSING_P1
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	766 and p1 != sha1nodeconstants.nullid
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	767 ):
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	768 entry.p1node = p1
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	769 entry.p1rev = self._nodetorev[p1]
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	770 entry.flags &= ~FLAG_MISSING_P1
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	771
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	772 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	773 'UPDATE fileindex SET p1rev=?, flags=? WHERE id=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	774 (self._nodetorev[p1], entry.flags, entry.rid),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	775 )
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	776
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	777 if (
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	778 entry.flags & FLAG_MISSING_P2
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	779 and p2 != sha1nodeconstants.nullid
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	780 ):
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	781 entry.p2node = p2
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	782 entry.p2rev = self._nodetorev[p2]
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	783 entry.flags &= ~FLAG_MISSING_P2
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	784
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	785 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	786 'UPDATE fileindex SET p2rev=?, flags=? WHERE id=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	787 (self._nodetorev[p1], entry.flags, entry.rid),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	788 )
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	789
45788 a5206e71c536 revlog: extend addgroup() with callback for duplicates Joerg Sonnenberger <joerg@bec.de> parents: 45372 diff changeset	790 if duplicaterevisioncb:
46509 7a93b7b3dc2d revlog: change addgroup callbacks to take revision numbers Joerg Sonnenberger <joerg@bec.de> parents: 46508 diff changeset	791 duplicaterevisioncb(self, self.rev(node))
45788 a5206e71c536 revlog: extend addgroup() with callback for duplicates Joerg Sonnenberger <joerg@bec.de> parents: 45372 diff changeset	792 empty = False
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	793 continue
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	794
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	795 if deltabase == sha1nodeconstants.nullid:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	796 text = mdiff.patch(b'', delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	797 storedelta = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	798 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	799 text = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	800 storedelta = (deltabase, delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	801
46509 7a93b7b3dc2d revlog: change addgroup callbacks to take revision numbers Joerg Sonnenberger <joerg@bec.de> parents: 46508 diff changeset	802 rev = self._addrawrevision(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	803 node,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	804 text,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	805 transaction,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	806 linkrev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	807 p1,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	808 p2,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	809 storedelta=storedelta,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	810 flags=storeflags,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	811 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	812
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	813 if addrevisioncb:
46509 7a93b7b3dc2d revlog: change addgroup callbacks to take revision numbers Joerg Sonnenberger <joerg@bec.de> parents: 46508 diff changeset	814 addrevisioncb(self, rev)
45788 a5206e71c536 revlog: extend addgroup() with callback for duplicates Joerg Sonnenberger <joerg@bec.de> parents: 45372 diff changeset	815 empty = False
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	816
45788 a5206e71c536 revlog: extend addgroup() with callback for duplicates Joerg Sonnenberger <joerg@bec.de> parents: 45372 diff changeset	817 return not empty
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	818
51267 ceeb8fa23cc8 censor: accept multiple revision in a single call Pierre-Yves David <pierre-yves.david@octobus.net> parents: 50794 diff changeset	819 def censorrevision(self, tr, censor_nodes, tombstone=b''):
ceeb8fa23cc8 censor: accept multiple revision in a single call Pierre-Yves David <pierre-yves.david@octobus.net> parents: 50794 diff changeset	820 for node in censor_nodes:
ceeb8fa23cc8 censor: accept multiple revision in a single call Pierre-Yves David <pierre-yves.david@octobus.net> parents: 50794 diff changeset	821 self._censor_one_revision(tr, node, tombstone=tombstone)
ceeb8fa23cc8 censor: accept multiple revision in a single call Pierre-Yves David <pierre-yves.david@octobus.net> parents: 50794 diff changeset	822
ceeb8fa23cc8 censor: accept multiple revision in a single call Pierre-Yves David <pierre-yves.david@octobus.net> parents: 50794 diff changeset	823 def _censor_one_revision(self, tr, censornode, tombstone):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	824 tombstone = storageutil.packmeta({b'censored': tombstone}, b'')
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	825
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	826 # This restriction is cargo culted from revlogs and makes no sense for
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	827 # SQLite, since columns can be resized at will.
42772 5c2e8a661418 rawdata: update callers in sqlitestore Pierre-Yves David <pierre-yves.david@octobus.net> parents: 42760 diff changeset	828 if len(tombstone) > len(self.rawdata(censornode)):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	829 raise error.Abort(
43117 8ff1ecfadcd1 cleanup: join string literals that are already on one line Martin von Zweigbergk <martinvonz@google.com> parents: 43077 diff changeset	830 _(b'censor tombstone must be no longer than censored data')
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	831 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	832
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	833 # We need to replace the censored revision's data with the tombstone.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	834 # But replacing that data will have implications for delta chains that
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	835 # reference it.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	836 #
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	837 # While "better," more complex strategies are possible, we do something
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	838 # simple: we find delta chain children of the censored revision and we
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	839 # replace those incremental deltas with fulltexts of their corresponding
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	840 # revision. Then we delete the now-unreferenced delta and original
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	841 # revision and insert a replacement.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	842
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	843 # Find the delta to be censored.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	844 censoreddeltaid = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	845 'SELECT deltaid FROM fileindex WHERE id=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	846 (self._revisions[censornode].rid,),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	847 ).fetchone()[0]
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	848
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	849 # Find all its delta chain children.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	850 # TODO once we support storing deltas for !files, we'll need to look
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	851 # for those delta chains too.
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	852 rows = list(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	853 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	854 'SELECT id, pathid, node FROM fileindex '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	855 'WHERE deltabaseid=? OR deltaid=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	856 (censoreddeltaid, censoreddeltaid),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	857 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	858 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	859
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	860 for row in rows:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	861 rid, pathid, node = row
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	862
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	863 fulltext = resolvedeltachain(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	864 self._db, pathid, node, {}, {-1: None}, zstddctx=self._dctx
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	865 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	866
44062 2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	867 deltahash = hashutil.sha1(fulltext).digest()
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	868
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	869 if self._compengine == b'zstd':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	870 deltablob = self._cctx.compress(fulltext)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	871 compression = COMPRESSION_ZSTD
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	872 elif self._compengine == b'zlib':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	873 deltablob = zlib.compress(fulltext)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	874 compression = COMPRESSION_ZLIB
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	875 elif self._compengine == b'none':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	876 deltablob = fulltext
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	877 compression = COMPRESSION_NONE
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	878 else:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	879 raise error.ProgrammingError(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	880 b'unhandled compression engine: %s' % self._compengine
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	881 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	882
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	883 if len(deltablob) >= len(fulltext):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	884 deltablob = fulltext
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	885 compression = COMPRESSION_NONE
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	886
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	887 deltaid = insertdelta(self._db, compression, deltahash, deltablob)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	888
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	889 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	890 'UPDATE fileindex SET deltaid=?, deltabaseid=NULL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	891 'WHERE id=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	892 (deltaid, rid),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	893 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	894
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	895 # Now create the tombstone delta and replace the delta on the censored
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	896 # node.
44062 2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	897 deltahash = hashutil.sha1(tombstone).digest()
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	898 tombstonedeltaid = insertdelta(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	899 self._db, COMPRESSION_NONE, deltahash, tombstone
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	900 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	901
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	902 flags = self._revisions[censornode].flags
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	903 flags \|= FLAG_CENSORED
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	904
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	905 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	906 'UPDATE fileindex SET flags=?, deltaid=?, deltabaseid=NULL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	907 'WHERE pathid=? AND node=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	908 (flags, tombstonedeltaid, self._pathid, censornode),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	909 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	910
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	911 self._db.execute('DELETE FROM delta WHERE id=?', (censoreddeltaid,))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	912
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	913 self._refreshindex()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	914 self._revisioncache.clear()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	915
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	916 def getstrippoint(self, minlink):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	917 return storageutil.resolvestripinfo(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	918 minlink,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	919 len(self) - 1,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	920 [self.rev(n) for n in self.heads()],
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	921 self.linkrev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	922 self.parentrevs,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	923 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	924
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	925 def strip(self, minlink, transaction):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	926 if not len(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	927 return
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	928
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	929 rev, _ignored = self.getstrippoint(minlink)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	930
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	931 if rev == len(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	932 return
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	933
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	934 for rev in self.revs(rev):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	935 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	936 'DELETE FROM fileindex WHERE pathid=? AND node=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	937 (self._pathid, self.node(rev)),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	938 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	939
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	940 # TODO how should we garbage collect data in delta table?
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	941
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	942 self._refreshindex()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	943
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	944 # End of ifilemutation interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	945
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	946 # Start of ifilestorage interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	947
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	948 def files(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	949 return []
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	950
46712 e8c11a2c96c0 delta: add sidedata field to revision delta Rapha?l Gom?s <rgomes@octobus.net> parents: 46711 diff changeset	951 def sidedata(self, nodeorrev, _df=None):
e8c11a2c96c0 delta: add sidedata field to revision delta Rapha?l Gom?s <rgomes@octobus.net> parents: 46711 diff changeset	952 # Not supported for now
e8c11a2c96c0 delta: add sidedata field to revision delta Rapha?l Gom?s <rgomes@octobus.net> parents: 46711 diff changeset	953 return {}
e8c11a2c96c0 delta: add sidedata field to revision delta Rapha?l Gom?s <rgomes@octobus.net> parents: 46711 diff changeset	954
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	955 def storageinfo(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	956 self,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	957 exclusivefiles=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	958 sharedfiles=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	959 revisionscount=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	960 trackedsize=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	961 storedsize=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	962 ):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	963 d = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	964
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	965 if exclusivefiles:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	966 d[b'exclusivefiles'] = []
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	967
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	968 if sharedfiles:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	969 # TODO list sqlite file(s) here.
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	970 d[b'sharedfiles'] = []
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	971
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	972 if revisionscount:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	973 d[b'revisionscount'] = len(self)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	974
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	975 if trackedsize:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	976 d[b'trackedsize'] = sum(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	977 len(self.revision(node)) for node in self._nodetorev
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	978 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	979
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	980 if storedsize:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	981 # TODO implement this?
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	982 d[b'storedsize'] = None
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	983
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	984 return d
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	985
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	986 def verifyintegrity(self, state):
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	987 state[b'skipread'] = set()
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	988
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	989 for rev in self:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	990 node = self.node(rev)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	991
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	992 try:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	993 self.revision(node)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	994 except Exception as e:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	995 yield sqliteproblem(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	996 error=_(b'unpacking %s: %s') % (short(node), e), node=node
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	997 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	998
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	999 state[b'skipread'].add(node)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1000
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1001 # End of ifilestorage interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1002
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1003 def _checkhash(self, fulltext, node, p1=None, p2=None):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1004 if p1 is None and p2 is None:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1005 p1, p2 = self.parents(node)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1006
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1007 if node == storageutil.hashrevisionsha1(fulltext, p1, p2):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1008 return
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1009
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1010 try:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1011 del self._revisioncache[node]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1012 except KeyError:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1013 pass
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1014
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1015 if storageutil.iscensoredtext(fulltext):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1016 raise error.CensoredNodeError(self._path, node, fulltext)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1017
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1018 raise SQLiteStoreError(_(b'integrity check failed on %s') % self._path)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1019
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1020 def _addrawrevision(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1021 self,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1022 node,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1023 revisiondata,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1024 transaction,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1025 linkrev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1026 p1,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1027 p2,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1028 storedelta=None,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1029 flags=0,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1030 ):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1031 if self._pathid is None:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1032 res = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1033 'INSERT INTO filepath (path) VALUES (?)', (self._path,)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1034 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1035 self._pathid = res.lastrowid
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1036
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1037 # For simplicity, always store a delta against p1.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1038 # TODO we need a lot more logic here to make behavior reasonable.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1039
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1040 if storedelta:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1041 deltabase, delta = storedelta
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1042
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1043 if isinstance(deltabase, int):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1044 deltabase = self.node(deltabase)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1045
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1046 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1047 assert revisiondata is not None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1048 deltabase = p1
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1049
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	1050 if deltabase == sha1nodeconstants.nullid:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1051 delta = revisiondata
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1052 else:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1053 delta = mdiff.textdiff(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1054 self.revision(self.rev(deltabase)), revisiondata
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1055 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1056
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1057 # File index stores a pointer to its delta and the parent delta.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1058 # The parent delta is stored via a pointer to the fileindex PK.
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	1059 if deltabase == sha1nodeconstants.nullid:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1060 baseid = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1061 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1062 baseid = self._revisions[deltabase].rid
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1063
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1064 # Deltas are stored with a hash of their content. This allows
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1065 # us to de-duplicate. The table is configured to ignore conflicts
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1066 # and it is faster to just insert and silently noop than to look
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1067 # first.
44062 2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	1068 deltahash = hashutil.sha1(delta).digest()
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1069
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1070 if self._compengine == b'zstd':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1071 deltablob = self._cctx.compress(delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1072 compression = COMPRESSION_ZSTD
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1073 elif self._compengine == b'zlib':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1074 deltablob = zlib.compress(delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1075 compression = COMPRESSION_ZLIB
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1076 elif self._compengine == b'none':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1077 deltablob = delta
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1078 compression = COMPRESSION_NONE
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1079 else:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1080 raise error.ProgrammingError(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1081 b'unhandled compression engine: %s' % self._compengine
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1082 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1083
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1084 # Don't store compressed data if it isn't practical.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1085 if len(deltablob) >= len(delta):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1086 deltablob = delta
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1087 compression = COMPRESSION_NONE
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1088
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1089 deltaid = insertdelta(self._db, compression, deltahash, deltablob)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1090
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1091 rev = len(self)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1092
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	1093 if p1 == sha1nodeconstants.nullid:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1094 p1rev = nullrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1095 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1096 p1rev = self._nodetorev[p1]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1097
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	1098 if p2 == sha1nodeconstants.nullid:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1099 p2rev = nullrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1100 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1101 p2rev = self._nodetorev[p2]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1102
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1103 rid = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1104 'INSERT INTO fileindex ('
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1105 ' pathid, revnum, node, p1rev, p2rev, linkrev, flags, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1106 ' deltaid, deltabaseid) '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1107 ' VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?)',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1108 (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1109 self._pathid,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1110 rev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1111 node,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1112 p1rev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1113 p2rev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1114 linkrev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1115 flags,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1116 deltaid,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1117 baseid,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1118 ),
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1119 ).lastrowid
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1120
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1121 entry = revisionentry(
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1122 rid=rid,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1123 rev=rev,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1124 node=node,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1125 p1rev=p1rev,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1126 p2rev=p2rev,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1127 p1node=p1,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1128 p2node=p2,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1129 linkrev=linkrev,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1130 flags=flags,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1131 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1132
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1133 self._nodetorev[node] = rev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1134 self._revtonode[rev] = node
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1135 self._revisions[node] = entry
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1136
46508 f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	1137 return rev
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1138
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1139
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1140 class sqliterepository(localrepo.localrepository):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1141 def cancopy(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1142 return False
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1143
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1144 def transaction(self, args, *kwargs):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1145 current = self.currenttransaction()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1146
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1147 tr = super(sqliterepository, self).transaction(args, *kwargs)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1148
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1149 if current:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1150 return tr
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1151
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1152 self._dbconn.execute('BEGIN TRANSACTION')
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1153
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1154 def committransaction(_):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1155 self._dbconn.commit()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1156
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1157 tr.addfinalize(b'sqlitestore', committransaction)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1158
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1159 return tr
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1160
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1161 @property
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1162 def _dbconn(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1163 # SQLite connections can only be used on the thread that created
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1164 # them. In most cases, this "just works." However, hgweb uses
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1165 # multiple threads.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1166 tid = threading.current_thread().ident
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1167
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1168 if self._db:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1169 if self._db[0] == tid:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1170 return self._db[1]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1171
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1172 db = makedb(self.svfs.join(b'db.sqlite'))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1173 self._db = (tid, db)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1174
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1175 return db
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1176
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1177
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1178 def makedb(path):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1179 """Construct a database handle for a database at path."""
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1180
40410 3b782669561d py3: make sure we pass sysstr in sqlite3.connect() Pulkit Goyal <pulkit@yandex-team.ru> parents: 40392 diff changeset	1181 db = sqlite3.connect(encoding.strfromlocal(path))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1182 db.text_factory = bytes
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1183
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1184 res = db.execute('PRAGMA user_version').fetchone()[0]
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1185
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1186 # New database.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1187 if res == 0:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1188 for statement in CREATE_SCHEMA:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1189 db.execute(statement)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1190
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1191 db.commit()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1192
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1193 elif res == CURRENT_SCHEMA_VERSION:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1194 pass
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1195
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1196 else:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1197 raise error.Abort(_(b'sqlite database has unrecognized version'))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1198
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1199 db.execute('PRAGMA journal_mode=WAL')
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1200
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1201 return db
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1202
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1203
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1204 def featuresetup(ui, supported):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1205 supported.add(REQUIREMENT)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1206
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1207 if zstd:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1208 supported.add(REQUIREMENT_ZSTD)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1209
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1210 supported.add(REQUIREMENT_ZLIB)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1211 supported.add(REQUIREMENT_NONE)
40390 7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1212 supported.add(REQUIREMENT_SHALLOW_FILES)
45372 77b8588dd84e requirements: introduce new requirements related module Pulkit Goyal <7895pulkit@gmail.com> parents: 44062 diff changeset	1213 supported.add(requirements.NARROW_REQUIREMENT)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1214
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1215
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1216 def newreporequirements(orig, ui, createopts):
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1217 if createopts[b'backend'] != b'sqlite':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1218 return orig(ui, createopts)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1219
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1220 # This restriction can be lifted once we have more confidence.
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1221 if b'sharedrepo' in createopts:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1222 raise error.Abort(
43117 8ff1ecfadcd1 cleanup: join string literals that are already on one line Martin von Zweigbergk <martinvonz@google.com> parents: 43077 diff changeset	1223 _(b'shared repositories not supported with SQLite store')
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1224 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1225
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1226 # This filtering is out of an abundance of caution: we want to ensure
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1227 # we honor creation options and we do that by annotating exactly the
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1228 # creation options we recognize.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1229 known = {
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1230 b'narrowfiles',
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1231 b'backend',
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1232 b'shallowfilestore',
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1233 }
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1234
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1235 unsupported = set(createopts) - known
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1236 if unsupported:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1237 raise error.Abort(
43117 8ff1ecfadcd1 cleanup: join string literals that are already on one line Martin von Zweigbergk <martinvonz@google.com> parents: 43077 diff changeset	1238 _(b'SQLite store does not support repo creation option: %s')
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1239 % b', '.join(sorted(unsupported))
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1240 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1241
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1242 # Since we're a hybrid store that still relies on revlogs, we fall back
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1243 # to using the revlogv1 backend's storage requirements then adding our
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1244 # own requirement.
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1245 createopts[b'backend'] = b'revlogv1'
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1246 requirements = orig(ui, createopts)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1247 requirements.add(REQUIREMENT)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1248
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1249 compression = ui.config(b'storage', b'sqlite.compression')
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1250
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1251 if compression == b'zstd' and not zstd:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1252 raise error.Abort(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1253 _(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1254 b'storage.sqlite.compression set to "zstd" but '
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1255 b'zstandard compression not available to this '
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1256 b'Mercurial install'
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1257 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1258 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1259
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1260 if compression == b'zstd':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1261 requirements.add(REQUIREMENT_ZSTD)
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1262 elif compression == b'zlib':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1263 requirements.add(REQUIREMENT_ZLIB)
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1264 elif compression == b'none':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1265 requirements.add(REQUIREMENT_NONE)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1266 else:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1267 raise error.Abort(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1268 _(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1269 b'unknown compression engine defined in '
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1270 b'storage.sqlite.compression: %s'
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1271 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1272 % compression
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1273 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1274
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1275 if createopts.get(b'shallowfilestore'):
40390 7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1276 requirements.add(REQUIREMENT_SHALLOW_FILES)
7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1277
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1278 return requirements
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1279
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1280
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1281 @interfaceutil.implementer(repository.ilocalrepositoryfilestorage)
48946 642e31cb55f0 py3: use class X: instead of class X(object): Gregory Szorc <gregory.szorc@gmail.com> parents: 48875 diff changeset	1282 class sqlitefilestorage:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1283 """Repository file storage backed by SQLite."""
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1284
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1285 def file(self, path):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1286 if path[0] == b'/':
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1287 path = path[1:]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1288
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1289 if REQUIREMENT_ZSTD in self.requirements:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1290 compression = b'zstd'
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1291 elif REQUIREMENT_ZLIB in self.requirements:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1292 compression = b'zlib'
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1293 elif REQUIREMENT_NONE in self.requirements:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1294 compression = b'none'
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1295 else:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1296 raise error.Abort(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1297 _(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1298 b'unable to determine what compression engine '
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1299 b'to use for SQLite storage'
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1300 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1301 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1302
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1303 return sqlitefilestore(self._dbconn, path, compression)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1304
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1305
40390 7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1306 def makefilestorage(orig, requirements, features, **kwargs):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1307 """Produce a type conforming to ``ilocalrepositoryfilestorage``."""
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1308 if REQUIREMENT in requirements:
40390 7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1309 if REQUIREMENT_SHALLOW_FILES in requirements:
7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1310 features.add(repository.REPO_FEATURE_SHALLOW_FILE_STORAGE)
7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1311
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1312 return sqlitefilestorage
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1313 else:
40390 7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1314 return orig(requirements=requirements, features=features, **kwargs)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1315
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1316
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1317 def makemain(orig, ui, requirements, **kwargs):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1318 if REQUIREMENT in requirements:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1319 if REQUIREMENT_ZSTD in requirements and not zstd:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1320 raise error.Abort(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1321 _(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1322 b'repository uses zstandard compression, which '
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1323 b'is not available to this Mercurial install'
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1324 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1325 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1326
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1327 return sqliterepository
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1328
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1329 return orig(requirements=requirements, **kwargs)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1330
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1331
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1332 def verifierinit(orig, self, args, *kwargs):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1333 orig(self, args, *kwargs)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1334
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1335 # We don't care that files in the store don't align with what is
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1336 # advertised. So suppress these warnings.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1337 self.warnorphanstorefiles = False
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1338
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1339
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1340 def extsetup(ui):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1341 localrepo.featuresetupfuncs.add(featuresetup)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1342 extensions.wrapfunction(
50794 4c6151b69085 wrapfunction: use sysstr instead of bytes as argument in "sqlitestore" Pierre-Yves David <pierre-yves.david@octobus.net> parents: 50790 diff changeset	1343 localrepo, 'newreporequirements', newreporequirements
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1344 )
50790 1fbae268ecae wrapfunction: use sysstr instead of bytes as argument in "sqlitestore" Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49849 diff changeset	1345 extensions.wrapfunction(localrepo, 'makefilestorage', makefilestorage)
1fbae268ecae wrapfunction: use sysstr instead of bytes as argument in "sqlitestore" Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49849 diff changeset	1346 extensions.wrapfunction(localrepo, 'makemain', makemain)
1fbae268ecae wrapfunction: use sysstr instead of bytes as argument in "sqlitestore" Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49849 diff changeset	1347 extensions.wrapfunction(verify.verifier, '__init__', verifierinit)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1348
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1349
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1350 def reposetup(ui, repo):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1351 if isinstance(repo, sqliterepository):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1352 repo._db = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1353
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1354 # TODO check for bundlerepository?

Mercurial > public > mercurial-scm > hg

annotate hgext/sqlitestore.py @ 51725:278af66e6595