mercurial-scm/hg: hgext/sqlitestore.py annotate

annotate hgext/sqlitestore.py @ 52487:3daaa5195a30

typing: align the signatures of `repository.ifilestorage` overrides This is the same as 048c11993d6a for `imanifestrevisionstored`, with the same belated realization about missing the Protocol marker. Since I've been jumping around to the various subclasses and copying extant hints to places where they're missing, do that here too. This also covers the 3 interfaces subclassed by `repository.ifilestorage` (`repository.ifileindex`, `repository.ifiledata`, and `repository.ifilemutation`). Obviously the whole base class needs hints, but I don't want to get side tracked here- it doesn't look like any of the implementing classes have any additional hints.

author	Matt Harbison <matt_harbison@yahoo.com>
date	Wed, 23 Oct 2024 12:21:52 -0400
parents	43d2a2f66434
children	ba8f03ad8906

rev	line source
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1 # sqlitestore.py - Storage backend that uses SQLite
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	2 #
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	3 # Copyright 2018 Gregory Szorc <gregory.szorc@gmail.com>
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	4 #
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	5 # This software may be used and distributed according to the terms of the
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	6 # GNU General Public License version 2 or any later version.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	7
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	8 """store repository data in SQLite (EXPERIMENTAL)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	9
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	10 The sqlitestore extension enables the storage of repository data in SQLite.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	11
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	12 This extension is HIGHLY EXPERIMENTAL. There are NO BACKWARDS COMPATIBILITY
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	13 GUARANTEES. This means that repositories created with this extension may
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	14 only be usable with the exact version of this extension/Mercurial that was
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	15 used. The extension attempts to enforce this in order to prevent repository
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	16 corruption.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	17
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	18 In addition, several features are not yet supported or have known bugs:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	19
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	20 * Only some data is stored in SQLite. Changeset, manifest, and other repository
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	21 data is not yet stored in SQLite.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	22 * Transactions are not robust. If the process is aborted at the right time
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	23 during transaction close/rollback, the repository could be in an inconsistent
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	24 state. This problem will diminish once all repository data is tracked by
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	25 SQLite.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	26 * Bundle repositories do not work (the ability to use e.g.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	27 `hg -R <bundle-file> log` to automatically overlay a bundle on top of the
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	28 existing repository).
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	29 * Various other features don't work.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	30
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	31 This extension should work for basic clone/pull, update, and commit workflows.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	32 Some history rewriting operations may fail due to lack of support for bundle
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	33 repositories.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	34
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	35 To use, activate the extension and set the ``storage.new-repo-backend`` config
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	36 option to ``sqlite`` to enable new repositories to use SQLite for storage.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	37 """
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	38
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	39 # To run the test suite with repos using SQLite by default, execute the
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	40 # following:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	41 #
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	42 # HGREPOFEATURES="sqlitestore" run-tests.py \
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	43 # --extra-config-opt extensions.sqlitestore= \
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	44 # --extra-config-opt storage.new-repo-backend=sqlite
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	45
51859 f4733654f144 typing: add `from __future__ import annotations` to most files Matt Harbison <matt_harbison@yahoo.com> parents: 51725 diff changeset	46 from __future__ import annotations
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	47
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	48 import sqlite3
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	49 import struct
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	50 import threading
51725 278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	51 import typing
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	52 import zlib
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	53
52468 4ef6dbc27a99 revlog: subclass the new `repository.iverifyproblem` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 51859 diff changeset	54 from typing import (
52487 3daaa5195a30 typing: align the signatures of `repository.ifilestorage` overrides Matt Harbison <matt_harbison@yahoo.com> parents: 52470 diff changeset	55 Iterable,
3daaa5195a30 typing: align the signatures of `repository.ifilestorage` overrides Matt Harbison <matt_harbison@yahoo.com> parents: 52470 diff changeset	56 Iterator,
52468 4ef6dbc27a99 revlog: subclass the new `repository.iverifyproblem` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 51859 diff changeset	57 Optional,
4ef6dbc27a99 revlog: subclass the new `repository.iverifyproblem` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 51859 diff changeset	58 )
4ef6dbc27a99 revlog: subclass the new `repository.iverifyproblem` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 51859 diff changeset	59
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	60 from mercurial.i18n import _
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	61 from mercurial.node import (
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	62 nullrev,
46780 6266d19556ad node: introduce nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46715 diff changeset	63 sha1nodeconstants,
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	64 short,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	65 )
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	66 from mercurial.thirdparty import attr
51725 278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	67
278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	68 # Force pytype to use the non-vendored package
278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	69 if typing.TYPE_CHECKING:
278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	70 # noinspection PyPackageRequirements
278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	71 import attr
278af66e6595 typing: induce pytype to use the standard `attr` instead of the vendored copy Matt Harbison <matt_harbison@yahoo.com> parents: 51699 diff changeset	72
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	73 from mercurial import (
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	74 ancestor,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	75 dagop,
40410 3b782669561d py3: make sure we pass sysstr in sqlite3.connect() Pulkit Goyal <pulkit@yandex-team.ru> parents: 40392 diff changeset	76 encoding,
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	77 error,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	78 extensions,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	79 localrepo,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	80 mdiff,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	81 pycompat,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	82 registrar,
45372 77b8588dd84e requirements: introduce new requirements related module Pulkit Goyal <7895pulkit@gmail.com> parents: 44062 diff changeset	83 requirements,
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	84 util,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	85 verify,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	86 )
42813 268662aac075 interfaces: create a new folder for interfaces and move repository.py in it Pulkit Goyal <pulkit@yandex-team.ru> parents: 42772 diff changeset	87 from mercurial.interfaces import (
268662aac075 interfaces: create a new folder for interfaces and move repository.py in it Pulkit Goyal <pulkit@yandex-team.ru> parents: 42772 diff changeset	88 repository,
42814 2c4f656c8e9f interfaceutil: move to interfaces/ Pulkit Goyal <pulkit@yandex-team.ru> parents: 42813 diff changeset	89 util as interfaceutil,
42813 268662aac075 interfaces: create a new folder for interfaces and move repository.py in it Pulkit Goyal <pulkit@yandex-team.ru> parents: 42772 diff changeset	90 )
44062 2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	91 from mercurial.utils import (
2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	92 hashutil,
2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	93 storageutil,
2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	94 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	95
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	96 try:
49849 de9ffb82ef4d typing: suppress a bunch of potential import-error cases in extensions Matt Harbison <matt_harbison@yahoo.com> parents: 49845 diff changeset	97 from mercurial import zstd # pytype: disable=import-error
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	98
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	99 zstd.__version__
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	100 except ImportError:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	101 zstd = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	102
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	103 configtable = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	104 configitem = registrar.configitem(configtable)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	105
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	106 # experimental config: storage.sqlite.compression
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	107 configitem(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	108 b'storage',
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	109 b'sqlite.compression',
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	110 default=b'zstd' if zstd else b'zlib',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	111 experimental=True,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	112 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	113
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	114 # Note for extension authors: ONLY specify testedwith = 'ships-with-hg-core' for
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	115 # extensions which SHIP WITH MERCURIAL. Non-mainline extensions should
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	116 # be specifying the version(s) of Mercurial they are tested with, or
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	117 # leave the attribute unspecified.
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	118 testedwith = b'ships-with-hg-core'
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	119
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	120 REQUIREMENT = b'exp-sqlite-001'
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	121 REQUIREMENT_ZSTD = b'exp-sqlite-comp-001=zstd'
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	122 REQUIREMENT_ZLIB = b'exp-sqlite-comp-001=zlib'
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	123 REQUIREMENT_NONE = b'exp-sqlite-comp-001=none'
40390 7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	124 REQUIREMENT_SHALLOW_FILES = b'exp-sqlite-shallow-files'
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	125
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	126 CURRENT_SCHEMA_VERSION = 1
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	127
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	128 COMPRESSION_NONE = 1
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	129 COMPRESSION_ZSTD = 2
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	130 COMPRESSION_ZLIB = 3
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	131
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	132 FLAG_CENSORED = 1
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	133 FLAG_MISSING_P1 = 2
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	134 FLAG_MISSING_P2 = 4
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	135
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	136 CREATE_SCHEMA = [
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	137 # Deltas are stored as content-indexed blobs.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	138 # compression column holds COMPRESSION_* constant for how the
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	139 # delta is encoded.
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	140 'CREATE TABLE delta ('
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	141 ' id INTEGER PRIMARY KEY, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	142 ' compression INTEGER NOT NULL, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	143 ' hash BLOB UNIQUE ON CONFLICT ABORT, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	144 ' delta BLOB NOT NULL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	145 ')',
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	146 # Tracked paths are denormalized to integers to avoid redundant
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	147 # storage of the path name.
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	148 'CREATE TABLE filepath ('
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	149 ' id INTEGER PRIMARY KEY, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	150 ' path BLOB NOT NULL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	151 ')',
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	152 'CREATE UNIQUE INDEX filepath_path ON filepath (path)',
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	153 # We have a single table for all file revision data.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	154 # Each file revision is uniquely described by a (path, rev) and
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	155 # (path, node).
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	156 #
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	157 # Revision data is stored as a pointer to the delta producing this
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	158 # revision and the file revision whose delta should be applied before
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	159 # that one. One can reconstruct the delta chain by recursively following
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	160 # the delta base revision pointers until one encounters NULL.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	161 #
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	162 # flags column holds bitwise integer flags controlling storage options.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	163 # These flags are defined by the FLAG_* constants.
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	164 'CREATE TABLE fileindex ('
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	165 ' id INTEGER PRIMARY KEY, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	166 ' pathid INTEGER REFERENCES filepath(id), '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	167 ' revnum INTEGER NOT NULL, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	168 ' p1rev INTEGER NOT NULL, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	169 ' p2rev INTEGER NOT NULL, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	170 ' linkrev INTEGER NOT NULL, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	171 ' flags INTEGER NOT NULL, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	172 ' deltaid INTEGER REFERENCES delta(id), '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	173 ' deltabaseid INTEGER REFERENCES fileindex(id), '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	174 ' node BLOB NOT NULL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	175 ')',
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	176 'CREATE UNIQUE INDEX fileindex_pathrevnum '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	177 ' ON fileindex (pathid, revnum)',
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	178 'CREATE UNIQUE INDEX fileindex_pathnode ON fileindex (pathid, node)',
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	179 # Provide a view over all file data for convenience.
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	180 'CREATE VIEW filedata AS '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	181 'SELECT '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	182 ' fileindex.id AS id, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	183 ' filepath.id AS pathid, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	184 ' filepath.path AS path, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	185 ' fileindex.revnum AS revnum, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	186 ' fileindex.node AS node, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	187 ' fileindex.p1rev AS p1rev, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	188 ' fileindex.p2rev AS p2rev, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	189 ' fileindex.linkrev AS linkrev, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	190 ' fileindex.flags AS flags, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	191 ' fileindex.deltaid AS deltaid, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	192 ' fileindex.deltabaseid AS deltabaseid '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	193 'FROM filepath, fileindex '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	194 'WHERE fileindex.pathid=filepath.id',
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	195 'PRAGMA user_version=%d' % CURRENT_SCHEMA_VERSION,
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	196 ]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	197
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	198
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	199 def resolvedeltachain(db, pathid, node, revisioncache, stoprids, zstddctx=None):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	200 """Resolve a delta chain for a file node."""
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	201
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	202 # TODO the "not in ({stops})" here is possibly slowing down the query
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	203 # because it needs to perform the lookup on every recursive invocation.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	204 # This could possibly be faster if we created a temporary query with
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	205 # baseid "poisoned" to null and limited the recursive filter to
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	206 # "is not null".
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	207 res = db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	208 'WITH RECURSIVE '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	209 ' deltachain(deltaid, baseid) AS ('
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	210 ' SELECT deltaid, deltabaseid FROM fileindex '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	211 ' WHERE pathid=? AND node=? '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	212 ' UNION ALL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	213 ' SELECT fileindex.deltaid, deltabaseid '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	214 ' FROM fileindex, deltachain '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	215 ' WHERE '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	216 ' fileindex.id=deltachain.baseid '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	217 ' AND deltachain.baseid IS NOT NULL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	218 ' AND fileindex.id NOT IN ({stops}) '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	219 ' ) '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	220 'SELECT deltachain.baseid, compression, delta '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	221 'FROM deltachain, delta '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	222 'WHERE delta.id=deltachain.deltaid'.format(
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	223 stops=','.join(['?'] * len(stoprids))
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	224 ),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	225 tuple([pathid, node] + list(stoprids.keys())),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	226 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	227
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	228 deltas = []
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	229 lastdeltabaseid = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	230
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	231 for deltabaseid, compression, delta in res:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	232 lastdeltabaseid = deltabaseid
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	233
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	234 if compression == COMPRESSION_ZSTD:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	235 delta = zstddctx.decompress(delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	236 elif compression == COMPRESSION_NONE:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	237 delta = delta
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	238 elif compression == COMPRESSION_ZLIB:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	239 delta = zlib.decompress(delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	240 else:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	241 raise SQLiteStoreError(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	242 b'unhandled compression type: %d' % compression
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	243 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	244
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	245 deltas.append(delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	246
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	247 if lastdeltabaseid in stoprids:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	248 basetext = revisioncache[stoprids[lastdeltabaseid]]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	249 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	250 basetext = deltas.pop()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	251
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	252 deltas.reverse()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	253 fulltext = mdiff.patches(basetext, deltas)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	254
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	255 # SQLite returns buffer instances for blob columns on Python 2. This
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	256 # type can propagate through the delta application layer. Because
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	257 # downstream callers assume revisions are bytes, cast as needed.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	258 if not isinstance(fulltext, bytes):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	259 fulltext = bytes(delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	260
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	261 return fulltext
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	262
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	263
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	264 def insertdelta(db, compression, hash, delta):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	265 try:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	266 return db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	267 'INSERT INTO delta (compression, hash, delta) VALUES (?, ?, ?)',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	268 (compression, hash, delta),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	269 ).lastrowid
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	270 except sqlite3.IntegrityError:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	271 return db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	272 'SELECT id FROM delta WHERE hash=?', (hash,)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	273 ).fetchone()[0]
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	274
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	275
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	276 class SQLiteStoreError(error.StorageError):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	277 pass
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	278
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	279
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	280 @attr.s
48946 642e31cb55f0 py3: use class X: instead of class X(object): Gregory Szorc <gregory.szorc@gmail.com> parents: 48875 diff changeset	281 class revisionentry:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	282 rid = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	283 rev = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	284 node = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	285 p1rev = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	286 p2rev = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	287 p1node = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	288 p2node = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	289 linkrev = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	290 flags = attr.ib()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	291
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	292
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	293 @attr.s(slots=True)
52470 43d2a2f66434 revlog: subclass the new `repository.irevisiondelta` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 52468 diff changeset	294 class sqliterevisiondelta(repository.irevisiondelta):
43d2a2f66434 revlog: subclass the new `repository.irevisiondelta` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 52468 diff changeset	295 node = attr.ib(type=bytes)
43d2a2f66434 revlog: subclass the new `repository.irevisiondelta` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 52468 diff changeset	296 p1node = attr.ib(type=bytes)
43d2a2f66434 revlog: subclass the new `repository.irevisiondelta` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 52468 diff changeset	297 p2node = attr.ib(type=bytes)
43d2a2f66434 revlog: subclass the new `repository.irevisiondelta` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 52468 diff changeset	298 basenode = attr.ib(type=bytes)
43d2a2f66434 revlog: subclass the new `repository.irevisiondelta` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 52468 diff changeset	299 flags = attr.ib(type=int)
43d2a2f66434 revlog: subclass the new `repository.irevisiondelta` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 52468 diff changeset	300 baserevisionsize = attr.ib(type=Optional[int])
43d2a2f66434 revlog: subclass the new `repository.irevisiondelta` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 52468 diff changeset	301 revision = attr.ib(type=Optional[bytes])
43d2a2f66434 revlog: subclass the new `repository.irevisiondelta` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 52468 diff changeset	302 delta = attr.ib(type=Optional[bytes])
43d2a2f66434 revlog: subclass the new `repository.irevisiondelta` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 52468 diff changeset	303 sidedata = attr.ib(type=Optional[bytes])
43d2a2f66434 revlog: subclass the new `repository.irevisiondelta` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 52468 diff changeset	304 protocol_flags = attr.ib(type=int)
43d2a2f66434 revlog: subclass the new `repository.irevisiondelta` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 52468 diff changeset	305 linknode = attr.ib(default=None, type=Optional[bytes])
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	306
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	307
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	308 @attr.s(frozen=True)
52468 4ef6dbc27a99 revlog: subclass the new `repository.iverifyproblem` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 51859 diff changeset	309 class sqliteproblem(repository.iverifyproblem):
4ef6dbc27a99 revlog: subclass the new `repository.iverifyproblem` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 51859 diff changeset	310 warning = attr.ib(default=None, type=Optional[bytes])
4ef6dbc27a99 revlog: subclass the new `repository.iverifyproblem` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 51859 diff changeset	311 error = attr.ib(default=None, type=Optional[bytes])
4ef6dbc27a99 revlog: subclass the new `repository.iverifyproblem` Protocol class Matt Harbison <matt_harbison@yahoo.com> parents: 51859 diff changeset	312 node = attr.ib(default=None, type=Optional[bytes])
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	313
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	314
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	315 @interfaceutil.implementer(repository.ifilestorage)
48946 642e31cb55f0 py3: use class X: instead of class X(object): Gregory Szorc <gregory.szorc@gmail.com> parents: 48875 diff changeset	316 class sqlitefilestore:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	317 """Implements storage for an individual tracked path."""
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	318
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	319 def __init__(self, db, path, compression):
46780 6266d19556ad node: introduce nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46715 diff changeset	320 self.nullid = sha1nodeconstants.nullid
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	321 self._db = db
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	322 self._path = path
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	323
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	324 self._pathid = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	325
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	326 # revnum -> node
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	327 self._revtonode = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	328 # node -> revnum
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	329 self._nodetorev = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	330 # node -> data structure
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	331 self._revisions = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	332
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	333 self._revisioncache = util.lrucachedict(10)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	334
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	335 self._compengine = compression
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	336
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	337 if compression == b'zstd':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	338 self._cctx = zstd.ZstdCompressor(level=3)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	339 self._dctx = zstd.ZstdDecompressor()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	340 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	341 self._cctx = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	342 self._dctx = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	343
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	344 self._refreshindex()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	345
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	346 def _refreshindex(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	347 self._revtonode = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	348 self._nodetorev = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	349 self._revisions = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	350
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	351 res = list(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	352 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	353 'SELECT id FROM filepath WHERE path=?', (self._path,)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	354 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	355 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	356
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	357 if not res:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	358 self._pathid = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	359 return
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	360
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	361 self._pathid = res[0][0]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	362
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	363 res = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	364 'SELECT id, revnum, node, p1rev, p2rev, linkrev, flags '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	365 'FROM fileindex '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	366 'WHERE pathid=? '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	367 'ORDER BY revnum ASC',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	368 (self._pathid,),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	369 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	370
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	371 for i, row in enumerate(res):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	372 rid, rev, node, p1rev, p2rev, linkrev, flags = row
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	373
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	374 if i != rev:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	375 raise SQLiteStoreError(
43117 8ff1ecfadcd1 cleanup: join string literals that are already on one line Martin von Zweigbergk <martinvonz@google.com> parents: 43077 diff changeset	376 _(b'sqlite database has inconsistent revision numbers')
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	377 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	378
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	379 if p1rev == nullrev:
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	380 p1node = sha1nodeconstants.nullid
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	381 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	382 p1node = self._revtonode[p1rev]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	383
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	384 if p2rev == nullrev:
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	385 p2node = sha1nodeconstants.nullid
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	386 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	387 p2node = self._revtonode[p2rev]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	388
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	389 entry = revisionentry(
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	390 rid=rid,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	391 rev=rev,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	392 node=node,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	393 p1rev=p1rev,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	394 p2rev=p2rev,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	395 p1node=p1node,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	396 p2node=p2node,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	397 linkrev=linkrev,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	398 flags=flags,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	399 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	400
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	401 self._revtonode[rev] = node
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	402 self._nodetorev[node] = rev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	403 self._revisions[node] = entry
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	404
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	405 # Start of ifileindex interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	406
52487 3daaa5195a30 typing: align the signatures of `repository.ifilestorage` overrides Matt Harbison <matt_harbison@yahoo.com> parents: 52470 diff changeset	407 def __len__(self) -> int:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	408 return len(self._revisions)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	409
52487 3daaa5195a30 typing: align the signatures of `repository.ifilestorage` overrides Matt Harbison <matt_harbison@yahoo.com> parents: 52470 diff changeset	410 def __iter__(self) -> Iterator[int]:
49284 d44e3c45f0e4 py3: replace `pycompat.xrange` by `range` Manuel Jacob <me@manueljacob.de> parents: 48946 diff changeset	411 return iter(range(len(self._revisions)))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	412
40387 f1a39128da95 filelog: add a hasnode() method (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 40326 diff changeset	413 def hasnode(self, node):
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	414 if node == sha1nodeconstants.nullid:
40387 f1a39128da95 filelog: add a hasnode() method (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 40326 diff changeset	415 return False
f1a39128da95 filelog: add a hasnode() method (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 40326 diff changeset	416
f1a39128da95 filelog: add a hasnode() method (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 40326 diff changeset	417 return node in self._nodetorev
f1a39128da95 filelog: add a hasnode() method (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 40326 diff changeset	418
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	419 def revs(self, start=0, stop=None):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	420 return storageutil.iterrevs(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	421 len(self._revisions), start=start, stop=stop
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	422 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	423
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	424 def parents(self, node):
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	425 if node == sha1nodeconstants.nullid:
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	426 return sha1nodeconstants.nullid, sha1nodeconstants.nullid
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	427
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	428 if node not in self._revisions:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	429 raise error.LookupError(node, self._path, _(b'no node'))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	430
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	431 entry = self._revisions[node]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	432 return entry.p1node, entry.p2node
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	433
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	434 def parentrevs(self, rev):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	435 if rev == nullrev:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	436 return nullrev, nullrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	437
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	438 if rev not in self._revtonode:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	439 raise IndexError(rev)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	440
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	441 entry = self._revisions[self._revtonode[rev]]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	442 return entry.p1rev, entry.p2rev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	443
49789 df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	444 def ancestors(self, revs, stoprev=0, inclusive=False):
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	445 """Generate the ancestors of 'revs' in reverse revision order.
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	446 Does not generate revs lower than stoprev.
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	447
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	448 See the documentation for ancestor.lazyancestors for more details."""
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	449
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	450 # first, make sure start revisions aren't filtered
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	451 revs = list(revs)
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	452 checkrev = self.node
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	453 for r in revs:
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	454 checkrev(r)
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	455
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	456 return ancestor.lazyancestors(
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	457 self.parentrevs,
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	458 revs,
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	459 stoprev=stoprev,
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	460 inclusive=inclusive,
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	461 )
df750b81272f sqlitestore: add an `ancestors` method Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	462
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	463 def rev(self, node):
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	464 if node == sha1nodeconstants.nullid:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	465 return nullrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	466
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	467 if node not in self._nodetorev:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	468 raise error.LookupError(node, self._path, _(b'no node'))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	469
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	470 return self._nodetorev[node]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	471
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	472 def node(self, rev):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	473 if rev == nullrev:
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	474 return sha1nodeconstants.nullid
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	475
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	476 if rev not in self._revtonode:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	477 raise IndexError(rev)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	478
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	479 return self._revtonode[rev]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	480
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	481 def lookup(self, node):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	482 return storageutil.fileidlookup(self, node, self._path)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	483
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	484 def linkrev(self, rev):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	485 if rev == nullrev:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	486 return nullrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	487
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	488 if rev not in self._revtonode:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	489 raise IndexError(rev)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	490
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	491 entry = self._revisions[self._revtonode[rev]]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	492 return entry.linkrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	493
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	494 def iscensored(self, rev):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	495 if rev == nullrev:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	496 return False
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	497
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	498 if rev not in self._revtonode:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	499 raise IndexError(rev)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	500
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	501 return self._revisions[self._revtonode[rev]].flags & FLAG_CENSORED
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	502
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	503 def commonancestorsheads(self, node1, node2):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	504 rev1 = self.rev(node1)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	505 rev2 = self.rev(node2)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	506
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	507 ancestors = ancestor.commonancestorsheads(self.parentrevs, rev1, rev2)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	508 return pycompat.maplist(self.node, ancestors)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	509
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	510 def descendants(self, revs):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	511 # TODO we could implement this using a recursive SQL query, which
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	512 # might be faster.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	513 return dagop.descendantrevs(revs, self.revs, self.parentrevs)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	514
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	515 def heads(self, start=None, stop=None):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	516 if start is None and stop is None:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	517 if not len(self):
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	518 return [sha1nodeconstants.nullid]
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	519
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	520 startrev = self.rev(start) if start is not None else nullrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	521 stoprevs = {self.rev(n) for n in stop or []}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	522
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	523 revs = dagop.headrevssubset(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	524 self.revs, self.parentrevs, startrev=startrev, stoprevs=stoprevs
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	525 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	526
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	527 return [self.node(rev) for rev in revs]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	528
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	529 def children(self, node):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	530 rev = self.rev(node)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	531
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	532 res = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	533 'SELECT'
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	534 ' node '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	535 ' FROM filedata '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	536 ' WHERE path=? AND (p1rev=? OR p2rev=?) '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	537 ' ORDER BY revnum ASC',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	538 (self._path, rev, rev),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	539 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	540
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	541 return [row[0] for row in res]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	542
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	543 # End of ifileindex interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	544
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	545 # Start of ifiledata interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	546
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	547 def size(self, rev):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	548 if rev == nullrev:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	549 return 0
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	550
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	551 if rev not in self._revtonode:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	552 raise IndexError(rev)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	553
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	554 node = self._revtonode[rev]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	555
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	556 if self.renamed(node):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	557 return len(self.read(node))
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	558
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	559 return len(self.revision(node))
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	560
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	561 def revision(self, node, raw=False, _verifyhash=True):
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	562 if node in (sha1nodeconstants.nullid, nullrev):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	563 return b''
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	564
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	565 if isinstance(node, int):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	566 node = self.node(node)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	567
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	568 if node not in self._nodetorev:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	569 raise error.LookupError(node, self._path, _(b'no node'))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	570
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	571 if node in self._revisioncache:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	572 return self._revisioncache[node]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	573
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	574 # Because we have a fulltext revision cache, we are able to
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	575 # short-circuit delta chain traversal and decompression as soon as
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	576 # we encounter a revision in the cache.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	577
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	578 stoprids = {self._revisions[n].rid: n for n in self._revisioncache}
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	579
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	580 if not stoprids:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	581 stoprids[-1] = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	582
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	583 fulltext = resolvedeltachain(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	584 self._db,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	585 self._pathid,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	586 node,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	587 self._revisioncache,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	588 stoprids,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	589 zstddctx=self._dctx,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	590 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	591
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	592 # Don't verify hashes if parent nodes were rewritten, as the hash
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	593 # wouldn't verify.
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	594 if self._revisions[node].flags & (FLAG_MISSING_P1 \| FLAG_MISSING_P2):
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	595 _verifyhash = False
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	596
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	597 if _verifyhash:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	598 self._checkhash(fulltext, node)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	599 self._revisioncache[node] = fulltext
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	600
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	601 return fulltext
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	602
42722 c9f3f4c8999a rawdata: implement `rawdata` for `sqlitestore` too Pierre-Yves David <pierre-yves.david@octobus.net> parents: 40460 diff changeset	603 def rawdata(self, args, *kwargs):
c9f3f4c8999a rawdata: implement `rawdata` for `sqlitestore` too Pierre-Yves David <pierre-yves.david@octobus.net> parents: 40460 diff changeset	604 return self.revision(args, *kwargs)
c9f3f4c8999a rawdata: implement `rawdata` for `sqlitestore` too Pierre-Yves David <pierre-yves.david@octobus.net> parents: 40460 diff changeset	605
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	606 def read(self, node):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	607 return storageutil.filtermetadata(self.revision(node))
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	608
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	609 def renamed(self, node):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	610 return storageutil.filerevisioncopied(self, node)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	611
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	612 def cmp(self, node, fulltext):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	613 return not storageutil.filedataequivalent(self, node, fulltext)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	614
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	615 def emitrevisions(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	616 self,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	617 nodes,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	618 nodesorder=None,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	619 revisiondata=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	620 assumehaveparentrevisions=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	621 deltamode=repository.CG_DELTAMODE_STD,
46715 45f0d5297698 changegroupv4: add sidedata helpers Rapha?l Gom?s <rgomes@octobus.net> parents: 46712 diff changeset	622 sidedata_helpers=None,
49609 9cac281eb9c0 debug: add an option to display statistic about a bundling operation Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49284 diff changeset	623 debug_info=None,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	624 ):
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	625 if nodesorder not in (b'nodes', b'storage', b'linear', None):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	626 raise error.ProgrammingError(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	627 b'unhandled value for nodesorder: %s' % nodesorder
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	628 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	629
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	630 nodes = [n for n in nodes if n != sha1nodeconstants.nullid]
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	631
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	632 if not nodes:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	633 return
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	634
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	635 # TODO perform in a single query.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	636 res = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	637 'SELECT revnum, deltaid FROM fileindex '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	638 'WHERE pathid=? '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	639 ' AND node in (%s)' % (','.join(['?'] * len(nodes))),
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	640 tuple([self._pathid] + nodes),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	641 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	642
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	643 deltabases = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	644
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	645 for rev, deltaid in res:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	646 res = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	647 'SELECT revnum from fileindex WHERE pathid=? AND deltaid=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	648 (self._pathid, deltaid),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	649 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	650 deltabases[rev] = res.fetchone()[0]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	651
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	652 # TODO define revdifffn so we can use delta from storage.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	653 for delta in storageutil.emitrevisions(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	654 self,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	655 nodes,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	656 nodesorder,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	657 sqliterevisiondelta,
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	658 deltaparentfn=deltabases.__getitem__,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	659 revisiondata=revisiondata,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	660 assumehaveparentrevisions=assumehaveparentrevisions,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	661 deltamode=deltamode,
46715 45f0d5297698 changegroupv4: add sidedata helpers Rapha?l Gom?s <rgomes@octobus.net> parents: 46712 diff changeset	662 sidedata_helpers=sidedata_helpers,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	663 ):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	664 yield delta
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	665
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	666 # End of ifiledata interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	667
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	668 # Start of ifilemutation interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	669
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	670 def add(self, filedata, meta, transaction, linkrev, p1, p2):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	671 if meta or filedata.startswith(b'\x01\n'):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	672 filedata = storageutil.packmeta(meta, filedata)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	673
46508 f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	674 rev = self.addrevision(filedata, transaction, linkrev, p1, p2)
f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	675 return self.node(rev)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	676
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	677 def addrevision(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	678 self,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	679 revisiondata,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	680 transaction,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	681 linkrev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	682 p1,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	683 p2,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	684 node=None,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	685 flags=0,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	686 cachedelta=None,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	687 ):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	688 if flags:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	689 raise SQLiteStoreError(_(b'flags not supported on revisions'))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	690
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	691 validatehash = node is not None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	692 node = node or storageutil.hashrevisionsha1(revisiondata, p1, p2)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	693
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	694 if validatehash:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	695 self._checkhash(revisiondata, node, p1, p2)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	696
46508 f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	697 rev = self._nodetorev.get(node)
f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	698 if rev is not None:
f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	699 return rev
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	700
46508 f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	701 rev = self._addrawrevision(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	702 node, revisiondata, transaction, linkrev, p1, p2
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	703 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	704
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	705 self._revisioncache[node] = revisiondata
46508 f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	706 return rev
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	707
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	708 def addgroup(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	709 self,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	710 deltas,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	711 linkmapper,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	712 transaction,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	713 addrevisioncb=None,
45788 a5206e71c536 revlog: extend addgroup() with callback for duplicates Joerg Sonnenberger <joerg@bec.de> parents: 45372 diff changeset	714 duplicaterevisioncb=None,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	715 maybemissingparents=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	716 ):
45788 a5206e71c536 revlog: extend addgroup() with callback for duplicates Joerg Sonnenberger <joerg@bec.de> parents: 45372 diff changeset	717 empty = True
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	718
46711 a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	719 for (
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	720 node,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	721 p1,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	722 p2,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	723 linknode,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	724 deltabase,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	725 delta,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	726 wireflags,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	727 sidedata,
a41565bef69f changegroup: add v4 changegroup for revlog v2 exchange Rapha?l Gom?s <rgomes@octobus.net> parents: 46509 diff changeset	728 ) in deltas:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	729 storeflags = 0
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	730
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	731 if wireflags & repository.REVISION_FLAG_CENSORED:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	732 storeflags \|= FLAG_CENSORED
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	733
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	734 if wireflags & ~repository.REVISION_FLAG_CENSORED:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	735 raise SQLiteStoreError(b'unhandled revision flag')
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	736
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	737 if maybemissingparents:
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	738 if p1 != sha1nodeconstants.nullid and not self.hasnode(p1):
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	739 p1 = sha1nodeconstants.nullid
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	740 storeflags \|= FLAG_MISSING_P1
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	741
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	742 if p2 != sha1nodeconstants.nullid and not self.hasnode(p2):
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	743 p2 = sha1nodeconstants.nullid
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	744 storeflags \|= FLAG_MISSING_P2
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	745
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	746 baserev = self.rev(deltabase)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	747
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	748 # If base is censored, delta must be full replacement in a single
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	749 # patch operation.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	750 if baserev != nullrev and self.iscensored(baserev):
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	751 hlen = struct.calcsize(b'>lll')
42772 5c2e8a661418 rawdata: update callers in sqlitestore Pierre-Yves David <pierre-yves.david@octobus.net> parents: 42760 diff changeset	752 oldlen = len(self.rawdata(deltabase, _verifyhash=False))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	753 newlen = len(delta) - hlen
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	754
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	755 if delta[:hlen] != mdiff.replacediffheader(oldlen, newlen):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	756 raise error.CensoredBaseError(self._path, deltabase)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	757
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	758 if not (storeflags & FLAG_CENSORED) and storageutil.deltaiscensored(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	759 delta, baserev, lambda x: len(self.rawdata(x))
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	760 ):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	761 storeflags \|= FLAG_CENSORED
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	762
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	763 linkrev = linkmapper(linknode)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	764
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	765 if node in self._revisions:
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	766 # Possibly reset parents to make them proper.
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	767 entry = self._revisions[node]
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	768
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	769 if (
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	770 entry.flags & FLAG_MISSING_P1
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	771 and p1 != sha1nodeconstants.nullid
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	772 ):
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	773 entry.p1node = p1
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	774 entry.p1rev = self._nodetorev[p1]
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	775 entry.flags &= ~FLAG_MISSING_P1
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	776
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	777 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	778 'UPDATE fileindex SET p1rev=?, flags=? WHERE id=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	779 (self._nodetorev[p1], entry.flags, entry.rid),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	780 )
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	781
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	782 if (
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	783 entry.flags & FLAG_MISSING_P2
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	784 and p2 != sha1nodeconstants.nullid
d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	785 ):
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	786 entry.p2node = p2
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	787 entry.p2rev = self._nodetorev[p2]
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	788 entry.flags &= ~FLAG_MISSING_P2
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	789
595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	790 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	791 'UPDATE fileindex SET p2rev=?, flags=? WHERE id=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	792 (self._nodetorev[p1], entry.flags, entry.rid),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	793 )
40392 595641bd8404 sqlitestore: support for storing revisions without their parents Gregory Szorc <gregory.szorc@gmail.com> parents: 40390 diff changeset	794
45788 a5206e71c536 revlog: extend addgroup() with callback for duplicates Joerg Sonnenberger <joerg@bec.de> parents: 45372 diff changeset	795 if duplicaterevisioncb:
46509 7a93b7b3dc2d revlog: change addgroup callbacks to take revision numbers Joerg Sonnenberger <joerg@bec.de> parents: 46508 diff changeset	796 duplicaterevisioncb(self, self.rev(node))
45788 a5206e71c536 revlog: extend addgroup() with callback for duplicates Joerg Sonnenberger <joerg@bec.de> parents: 45372 diff changeset	797 empty = False
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	798 continue
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	799
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	800 if deltabase == sha1nodeconstants.nullid:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	801 text = mdiff.patch(b'', delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	802 storedelta = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	803 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	804 text = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	805 storedelta = (deltabase, delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	806
46509 7a93b7b3dc2d revlog: change addgroup callbacks to take revision numbers Joerg Sonnenberger <joerg@bec.de> parents: 46508 diff changeset	807 rev = self._addrawrevision(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	808 node,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	809 text,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	810 transaction,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	811 linkrev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	812 p1,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	813 p2,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	814 storedelta=storedelta,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	815 flags=storeflags,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	816 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	817
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	818 if addrevisioncb:
46509 7a93b7b3dc2d revlog: change addgroup callbacks to take revision numbers Joerg Sonnenberger <joerg@bec.de> parents: 46508 diff changeset	819 addrevisioncb(self, rev)
45788 a5206e71c536 revlog: extend addgroup() with callback for duplicates Joerg Sonnenberger <joerg@bec.de> parents: 45372 diff changeset	820 empty = False
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	821
45788 a5206e71c536 revlog: extend addgroup() with callback for duplicates Joerg Sonnenberger <joerg@bec.de> parents: 45372 diff changeset	822 return not empty
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	823
51267 ceeb8fa23cc8 censor: accept multiple revision in a single call Pierre-Yves David <pierre-yves.david@octobus.net> parents: 50794 diff changeset	824 def censorrevision(self, tr, censor_nodes, tombstone=b''):
ceeb8fa23cc8 censor: accept multiple revision in a single call Pierre-Yves David <pierre-yves.david@octobus.net> parents: 50794 diff changeset	825 for node in censor_nodes:
ceeb8fa23cc8 censor: accept multiple revision in a single call Pierre-Yves David <pierre-yves.david@octobus.net> parents: 50794 diff changeset	826 self._censor_one_revision(tr, node, tombstone=tombstone)
ceeb8fa23cc8 censor: accept multiple revision in a single call Pierre-Yves David <pierre-yves.david@octobus.net> parents: 50794 diff changeset	827
ceeb8fa23cc8 censor: accept multiple revision in a single call Pierre-Yves David <pierre-yves.david@octobus.net> parents: 50794 diff changeset	828 def _censor_one_revision(self, tr, censornode, tombstone):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	829 tombstone = storageutil.packmeta({b'censored': tombstone}, b'')
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	830
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	831 # This restriction is cargo culted from revlogs and makes no sense for
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	832 # SQLite, since columns can be resized at will.
42772 5c2e8a661418 rawdata: update callers in sqlitestore Pierre-Yves David <pierre-yves.david@octobus.net> parents: 42760 diff changeset	833 if len(tombstone) > len(self.rawdata(censornode)):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	834 raise error.Abort(
43117 8ff1ecfadcd1 cleanup: join string literals that are already on one line Martin von Zweigbergk <martinvonz@google.com> parents: 43077 diff changeset	835 _(b'censor tombstone must be no longer than censored data')
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	836 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	837
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	838 # We need to replace the censored revision's data with the tombstone.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	839 # But replacing that data will have implications for delta chains that
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	840 # reference it.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	841 #
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	842 # While "better," more complex strategies are possible, we do something
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	843 # simple: we find delta chain children of the censored revision and we
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	844 # replace those incremental deltas with fulltexts of their corresponding
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	845 # revision. Then we delete the now-unreferenced delta and original
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	846 # revision and insert a replacement.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	847
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	848 # Find the delta to be censored.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	849 censoreddeltaid = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	850 'SELECT deltaid FROM fileindex WHERE id=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	851 (self._revisions[censornode].rid,),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	852 ).fetchone()[0]
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	853
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	854 # Find all its delta chain children.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	855 # TODO once we support storing deltas for !files, we'll need to look
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	856 # for those delta chains too.
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	857 rows = list(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	858 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	859 'SELECT id, pathid, node FROM fileindex '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	860 'WHERE deltabaseid=? OR deltaid=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	861 (censoreddeltaid, censoreddeltaid),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	862 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	863 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	864
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	865 for row in rows:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	866 rid, pathid, node = row
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	867
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	868 fulltext = resolvedeltachain(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	869 self._db, pathid, node, {}, {-1: None}, zstddctx=self._dctx
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	870 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	871
44062 2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	872 deltahash = hashutil.sha1(fulltext).digest()
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	873
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	874 if self._compengine == b'zstd':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	875 deltablob = self._cctx.compress(fulltext)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	876 compression = COMPRESSION_ZSTD
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	877 elif self._compengine == b'zlib':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	878 deltablob = zlib.compress(fulltext)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	879 compression = COMPRESSION_ZLIB
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	880 elif self._compengine == b'none':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	881 deltablob = fulltext
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	882 compression = COMPRESSION_NONE
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	883 else:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	884 raise error.ProgrammingError(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	885 b'unhandled compression engine: %s' % self._compengine
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	886 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	887
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	888 if len(deltablob) >= len(fulltext):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	889 deltablob = fulltext
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	890 compression = COMPRESSION_NONE
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	891
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	892 deltaid = insertdelta(self._db, compression, deltahash, deltablob)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	893
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	894 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	895 'UPDATE fileindex SET deltaid=?, deltabaseid=NULL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	896 'WHERE id=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	897 (deltaid, rid),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	898 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	899
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	900 # Now create the tombstone delta and replace the delta on the censored
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	901 # node.
44062 2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	902 deltahash = hashutil.sha1(tombstone).digest()
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	903 tombstonedeltaid = insertdelta(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	904 self._db, COMPRESSION_NONE, deltahash, tombstone
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	905 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	906
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	907 flags = self._revisions[censornode].flags
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	908 flags \|= FLAG_CENSORED
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	909
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	910 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	911 'UPDATE fileindex SET flags=?, deltaid=?, deltabaseid=NULL '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	912 'WHERE pathid=? AND node=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	913 (flags, tombstonedeltaid, self._pathid, censornode),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	914 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	915
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	916 self._db.execute('DELETE FROM delta WHERE id=?', (censoreddeltaid,))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	917
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	918 self._refreshindex()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	919 self._revisioncache.clear()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	920
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	921 def getstrippoint(self, minlink):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	922 return storageutil.resolvestripinfo(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	923 minlink,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	924 len(self) - 1,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	925 [self.rev(n) for n in self.heads()],
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	926 self.linkrev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	927 self.parentrevs,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	928 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	929
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	930 def strip(self, minlink, transaction):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	931 if not len(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	932 return
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	933
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	934 rev, _ignored = self.getstrippoint(minlink)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	935
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	936 if rev == len(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	937 return
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	938
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	939 for rev in self.revs(rev):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	940 self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	941 'DELETE FROM fileindex WHERE pathid=? AND node=?',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	942 (self._pathid, self.node(rev)),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	943 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	944
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	945 # TODO how should we garbage collect data in delta table?
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	946
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	947 self._refreshindex()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	948
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	949 # End of ifilemutation interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	950
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	951 # Start of ifilestorage interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	952
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	953 def files(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	954 return []
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	955
46712 e8c11a2c96c0 delta: add sidedata field to revision delta Rapha?l Gom?s <rgomes@octobus.net> parents: 46711 diff changeset	956 def sidedata(self, nodeorrev, _df=None):
e8c11a2c96c0 delta: add sidedata field to revision delta Rapha?l Gom?s <rgomes@octobus.net> parents: 46711 diff changeset	957 # Not supported for now
e8c11a2c96c0 delta: add sidedata field to revision delta Rapha?l Gom?s <rgomes@octobus.net> parents: 46711 diff changeset	958 return {}
e8c11a2c96c0 delta: add sidedata field to revision delta Rapha?l Gom?s <rgomes@octobus.net> parents: 46711 diff changeset	959
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	960 def storageinfo(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	961 self,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	962 exclusivefiles=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	963 sharedfiles=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	964 revisionscount=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	965 trackedsize=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	966 storedsize=False,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	967 ):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	968 d = {}
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	969
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	970 if exclusivefiles:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	971 d[b'exclusivefiles'] = []
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	972
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	973 if sharedfiles:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	974 # TODO list sqlite file(s) here.
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	975 d[b'sharedfiles'] = []
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	976
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	977 if revisionscount:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	978 d[b'revisionscount'] = len(self)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	979
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	980 if trackedsize:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	981 d[b'trackedsize'] = sum(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	982 len(self.revision(node)) for node in self._nodetorev
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	983 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	984
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	985 if storedsize:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	986 # TODO implement this?
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	987 d[b'storedsize'] = None
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	988
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	989 return d
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	990
52487 3daaa5195a30 typing: align the signatures of `repository.ifilestorage` overrides Matt Harbison <matt_harbison@yahoo.com> parents: 52470 diff changeset	991 def verifyintegrity(self, state) -> Iterable[repository.iverifyproblem]:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	992 state[b'skipread'] = set()
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	993
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	994 for rev in self:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	995 node = self.node(rev)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	996
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	997 try:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	998 self.revision(node)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	999 except Exception as e:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1000 yield sqliteproblem(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1001 error=_(b'unpacking %s: %s') % (short(node), e), node=node
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1002 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1003
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1004 state[b'skipread'].add(node)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1005
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1006 # End of ifilestorage interface.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1007
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1008 def _checkhash(self, fulltext, node, p1=None, p2=None):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1009 if p1 is None and p2 is None:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1010 p1, p2 = self.parents(node)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1011
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1012 if node == storageutil.hashrevisionsha1(fulltext, p1, p2):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1013 return
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1014
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1015 try:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1016 del self._revisioncache[node]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1017 except KeyError:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1018 pass
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1019
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1020 if storageutil.iscensoredtext(fulltext):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1021 raise error.CensoredNodeError(self._path, node, fulltext)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1022
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1023 raise SQLiteStoreError(_(b'integrity check failed on %s') % self._path)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1024
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1025 def _addrawrevision(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1026 self,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1027 node,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1028 revisiondata,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1029 transaction,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1030 linkrev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1031 p1,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1032 p2,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1033 storedelta=None,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1034 flags=0,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1035 ):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1036 if self._pathid is None:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1037 res = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1038 'INSERT INTO filepath (path) VALUES (?)', (self._path,)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1039 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1040 self._pathid = res.lastrowid
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1041
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1042 # For simplicity, always store a delta against p1.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1043 # TODO we need a lot more logic here to make behavior reasonable.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1044
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1045 if storedelta:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1046 deltabase, delta = storedelta
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1047
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1048 if isinstance(deltabase, int):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1049 deltabase = self.node(deltabase)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1050
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1051 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1052 assert revisiondata is not None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1053 deltabase = p1
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1054
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	1055 if deltabase == sha1nodeconstants.nullid:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1056 delta = revisiondata
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1057 else:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1058 delta = mdiff.textdiff(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1059 self.revision(self.rev(deltabase)), revisiondata
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1060 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1061
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1062 # File index stores a pointer to its delta and the parent delta.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1063 # The parent delta is stored via a pointer to the fileindex PK.
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	1064 if deltabase == sha1nodeconstants.nullid:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1065 baseid = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1066 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1067 baseid = self._revisions[deltabase].rid
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1068
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1069 # Deltas are stored with a hash of their content. This allows
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1070 # us to de-duplicate. The table is configured to ignore conflicts
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1071 # and it is faster to just insert and silently noop than to look
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1072 # first.
44062 2d49482d0dd4 hgext: replace references to hashlib.sha1 with hashutil.sha1 Augie Fackler <augie@google.com> parents: 43507 diff changeset	1073 deltahash = hashutil.sha1(delta).digest()
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1074
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1075 if self._compengine == b'zstd':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1076 deltablob = self._cctx.compress(delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1077 compression = COMPRESSION_ZSTD
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1078 elif self._compengine == b'zlib':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1079 deltablob = zlib.compress(delta)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1080 compression = COMPRESSION_ZLIB
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1081 elif self._compengine == b'none':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1082 deltablob = delta
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1083 compression = COMPRESSION_NONE
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1084 else:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1085 raise error.ProgrammingError(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1086 b'unhandled compression engine: %s' % self._compengine
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1087 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1088
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1089 # Don't store compressed data if it isn't practical.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1090 if len(deltablob) >= len(delta):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1091 deltablob = delta
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1092 compression = COMPRESSION_NONE
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1093
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1094 deltaid = insertdelta(self._db, compression, deltahash, deltablob)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1095
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1096 rev = len(self)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1097
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	1098 if p1 == sha1nodeconstants.nullid:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1099 p1rev = nullrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1100 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1101 p1rev = self._nodetorev[p1]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1102
47012 d55b71393907 node: replace nullid and friends with nodeconstants class Joerg Sonnenberger <joerg@bec.de> parents: 46780 diff changeset	1103 if p2 == sha1nodeconstants.nullid:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1104 p2rev = nullrev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1105 else:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1106 p2rev = self._nodetorev[p2]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1107
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1108 rid = self._db.execute(
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1109 'INSERT INTO fileindex ('
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1110 ' pathid, revnum, node, p1rev, p2rev, linkrev, flags, '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1111 ' deltaid, deltabaseid) '
adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1112 ' VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?)',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1113 (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1114 self._pathid,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1115 rev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1116 node,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1117 p1rev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1118 p2rev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1119 linkrev,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1120 flags,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1121 deltaid,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1122 baseid,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1123 ),
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1124 ).lastrowid
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1125
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1126 entry = revisionentry(
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1127 rid=rid,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1128 rev=rev,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1129 node=node,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1130 p1rev=p1rev,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1131 p2rev=p2rev,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1132 p1node=p1,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1133 p2node=p2,
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1134 linkrev=linkrev,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1135 flags=flags,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1136 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1137
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1138 self._nodetorev[node] = rev
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1139 self._revtonode[rev] = node
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1140 self._revisions[node] = entry
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1141
46508 f7b61ad3c64a revlog: change addrevision to return the new revision, not node Joerg Sonnenberger <joerg@bec.de> parents: 45788 diff changeset	1142 return rev
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1143
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1144
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1145 class sqliterepository(localrepo.localrepository):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1146 def cancopy(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1147 return False
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1148
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1149 def transaction(self, args, *kwargs):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1150 current = self.currenttransaction()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1151
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1152 tr = super(sqliterepository, self).transaction(args, *kwargs)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1153
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1154 if current:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1155 return tr
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1156
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1157 self._dbconn.execute('BEGIN TRANSACTION')
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1158
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1159 def committransaction(_):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1160 self._dbconn.commit()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1161
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1162 tr.addfinalize(b'sqlitestore', committransaction)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1163
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1164 return tr
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1165
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1166 @property
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1167 def _dbconn(self):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1168 # SQLite connections can only be used on the thread that created
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1169 # them. In most cases, this "just works." However, hgweb uses
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1170 # multiple threads.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1171 tid = threading.current_thread().ident
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1172
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1173 if self._db:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1174 if self._db[0] == tid:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1175 return self._db[1]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1176
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1177 db = makedb(self.svfs.join(b'db.sqlite'))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1178 self._db = (tid, db)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1179
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1180 return db
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1181
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1182
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1183 def makedb(path):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1184 """Construct a database handle for a database at path."""
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1185
40410 3b782669561d py3: make sure we pass sysstr in sqlite3.connect() Pulkit Goyal <pulkit@yandex-team.ru> parents: 40392 diff changeset	1186 db = sqlite3.connect(encoding.strfromlocal(path))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1187 db.text_factory = bytes
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1188
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1189 res = db.execute('PRAGMA user_version').fetchone()[0]
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1190
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1191 # New database.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1192 if res == 0:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1193 for statement in CREATE_SCHEMA:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1194 db.execute(statement)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1195
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1196 db.commit()
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1197
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1198 elif res == CURRENT_SCHEMA_VERSION:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1199 pass
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1200
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1201 else:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1202 raise error.Abort(_(b'sqlite database has unrecognized version'))
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1203
43507 adde839cc54f sqlitestore: remove superfluous r-prefixes on strings Augie Fackler <augie@google.com> parents: 43117 diff changeset	1204 db.execute('PRAGMA journal_mode=WAL')
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1205
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1206 return db
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1207
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1208
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1209 def featuresetup(ui, supported):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1210 supported.add(REQUIREMENT)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1211
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1212 if zstd:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1213 supported.add(REQUIREMENT_ZSTD)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1214
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1215 supported.add(REQUIREMENT_ZLIB)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1216 supported.add(REQUIREMENT_NONE)
40390 7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1217 supported.add(REQUIREMENT_SHALLOW_FILES)
45372 77b8588dd84e requirements: introduce new requirements related module Pulkit Goyal <7895pulkit@gmail.com> parents: 44062 diff changeset	1218 supported.add(requirements.NARROW_REQUIREMENT)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1219
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1220
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1221 def newreporequirements(orig, ui, createopts):
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1222 if createopts[b'backend'] != b'sqlite':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1223 return orig(ui, createopts)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1224
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1225 # This restriction can be lifted once we have more confidence.
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1226 if b'sharedrepo' in createopts:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1227 raise error.Abort(
43117 8ff1ecfadcd1 cleanup: join string literals that are already on one line Martin von Zweigbergk <martinvonz@google.com> parents: 43077 diff changeset	1228 _(b'shared repositories not supported with SQLite store')
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1229 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1230
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1231 # This filtering is out of an abundance of caution: we want to ensure
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1232 # we honor creation options and we do that by annotating exactly the
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1233 # creation options we recognize.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1234 known = {
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1235 b'narrowfiles',
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1236 b'backend',
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1237 b'shallowfilestore',
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1238 }
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1239
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1240 unsupported = set(createopts) - known
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1241 if unsupported:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1242 raise error.Abort(
43117 8ff1ecfadcd1 cleanup: join string literals that are already on one line Martin von Zweigbergk <martinvonz@google.com> parents: 43077 diff changeset	1243 _(b'SQLite store does not support repo creation option: %s')
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1244 % b', '.join(sorted(unsupported))
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1245 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1246
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1247 # Since we're a hybrid store that still relies on revlogs, we fall back
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1248 # to using the revlogv1 backend's storage requirements then adding our
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1249 # own requirement.
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1250 createopts[b'backend'] = b'revlogv1'
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1251 requirements = orig(ui, createopts)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1252 requirements.add(REQUIREMENT)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1253
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1254 compression = ui.config(b'storage', b'sqlite.compression')
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1255
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1256 if compression == b'zstd' and not zstd:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1257 raise error.Abort(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1258 _(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1259 b'storage.sqlite.compression set to "zstd" but '
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1260 b'zstandard compression not available to this '
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1261 b'Mercurial install'
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1262 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1263 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1264
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1265 if compression == b'zstd':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1266 requirements.add(REQUIREMENT_ZSTD)
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1267 elif compression == b'zlib':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1268 requirements.add(REQUIREMENT_ZLIB)
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1269 elif compression == b'none':
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1270 requirements.add(REQUIREMENT_NONE)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1271 else:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1272 raise error.Abort(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1273 _(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1274 b'unknown compression engine defined in '
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1275 b'storage.sqlite.compression: %s'
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1276 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1277 % compression
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1278 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1279
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1280 if createopts.get(b'shallowfilestore'):
40390 7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1281 requirements.add(REQUIREMENT_SHALLOW_FILES)
7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1282
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1283 return requirements
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1284
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1285
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1286 @interfaceutil.implementer(repository.ilocalrepositoryfilestorage)
48946 642e31cb55f0 py3: use class X: instead of class X(object): Gregory Szorc <gregory.szorc@gmail.com> parents: 48875 diff changeset	1287 class sqlitefilestorage:
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1288 """Repository file storage backed by SQLite."""
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1289
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1290 def file(self, path):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1291 if path[0] == b'/':
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1292 path = path[1:]
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1293
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1294 if REQUIREMENT_ZSTD in self.requirements:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1295 compression = b'zstd'
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1296 elif REQUIREMENT_ZLIB in self.requirements:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1297 compression = b'zlib'
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1298 elif REQUIREMENT_NONE in self.requirements:
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1299 compression = b'none'
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1300 else:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1301 raise error.Abort(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1302 _(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1303 b'unable to determine what compression engine '
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1304 b'to use for SQLite storage'
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1305 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1306 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1307
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1308 return sqlitefilestore(self._dbconn, path, compression)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1309
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1310
40390 7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1311 def makefilestorage(orig, requirements, features, **kwargs):
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1312 """Produce a type conforming to ``ilocalrepositoryfilestorage``."""
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1313 if REQUIREMENT in requirements:
40390 7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1314 if REQUIREMENT_SHALLOW_FILES in requirements:
7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1315 features.add(repository.REPO_FEATURE_SHALLOW_FILE_STORAGE)
7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1316
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1317 return sqlitefilestorage
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1318 else:
40390 7e3b6c4f01a2 localrepo: support marking repos as having shallow file storage Gregory Szorc <gregory.szorc@gmail.com> parents: 40389 diff changeset	1319 return orig(requirements=requirements, features=features, **kwargs)
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1320
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1321
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1322 def makemain(orig, ui, requirements, **kwargs):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1323 if REQUIREMENT in requirements:
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1324 if REQUIREMENT_ZSTD in requirements and not zstd:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1325 raise error.Abort(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1326 _(
43077 687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1327 b'repository uses zstandard compression, which '
687b865b95ad formatting: byteify all mercurial/ and hgext/ string literals Augie Fackler <augie@google.com> parents: 43076 diff changeset	1328 b'is not available to this Mercurial install'
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1329 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1330 )
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1331
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1332 return sqliterepository
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1333
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1334 return orig(requirements=requirements, **kwargs)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1335
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1336
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1337 def verifierinit(orig, self, args, *kwargs):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1338 orig(self, args, *kwargs)
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1339
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1340 # We don't care that files in the store don't align with what is
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1341 # advertised. So suppress these warnings.
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1342 self.warnorphanstorefiles = False
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1343
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1344
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1345 def extsetup(ui):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1346 localrepo.featuresetupfuncs.add(featuresetup)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1347 extensions.wrapfunction(
50794 4c6151b69085 wrapfunction: use sysstr instead of bytes as argument in "sqlitestore" Pierre-Yves David <pierre-yves.david@octobus.net> parents: 50790 diff changeset	1348 localrepo, 'newreporequirements', newreporequirements
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1349 )
50790 1fbae268ecae wrapfunction: use sysstr instead of bytes as argument in "sqlitestore" Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49849 diff changeset	1350 extensions.wrapfunction(localrepo, 'makefilestorage', makefilestorage)
1fbae268ecae wrapfunction: use sysstr instead of bytes as argument in "sqlitestore" Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49849 diff changeset	1351 extensions.wrapfunction(localrepo, 'makemain', makemain)
1fbae268ecae wrapfunction: use sysstr instead of bytes as argument in "sqlitestore" Pierre-Yves David <pierre-yves.david@octobus.net> parents: 49849 diff changeset	1352 extensions.wrapfunction(verify.verifier, '__init__', verifierinit)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 42814 diff changeset	1353
40326 fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1354
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1355 def reposetup(ui, repo):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1356 if isinstance(repo, sqliterepository):
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1357 repo._db = None
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1358
fed697fa1734 sqlitestore: file storage backend using SQLite Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1359 # TODO check for bundlerepository?

Mercurial > public > mercurial-scm > hg

annotate hgext/sqlitestore.py @ 52487:3daaa5195a30