mercurial-scm/hg-stable: contrib/perf.py annotate

annotate contrib/perf.py @ 40600:631011ff6771

perf: add the notion of "source" to perfrevlogwrite We want to test performance associated witch various way to add a new revision. They will be specified using this new argument.

author	Boris Feld <boris.feld@octobus.net>
date	Fri, 19 Oct 2018 17:23:29 +0200
parents	c63081cd3902
children	6c2357029364

rev	line source
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	1 # perf.py - performance test routines
8873 e872ef2e6758 help: add/fix docstrings for a bunch of extensions Dirkjan Ochtman <dirkjan@ochtman.nl> parents: 8656 diff changeset	2 '''helper extension to measure performance'''
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	3
29493 4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	4 # "historical portability" policy of perf.py:
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	5 #
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	6 # We have to do:
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	7 # - make perf.py "loadable" with as wide Mercurial version as possible
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	8 # This doesn't mean that perf commands work correctly with that Mercurial.
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	9 # BTW, perf.py itself has been available since 1.1 (or eb240755386d).
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	10 # - make historical perf command work correctly with as wide Mercurial
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	11 # version as possible
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	12 #
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	13 # We have to do, if possible with reasonable cost:
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	14 # - make recent perf command for historical feature work correctly
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	15 # with early Mercurial
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	16 #
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	17 # We don't have to do:
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	18 # - make perf command for recent feature work correctly with early
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	19 # Mercurial
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	20
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	21 from __future__ import absolute_import
40144 acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	22 import contextlib
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	23 import functools
31406 8f5ed8fa39f8 perf: perform a garbage collection before each iteration Gregory Szorc <gregory.szorc@gmail.com> parents: 30997 diff changeset	24 import gc
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	25 import os
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	26 import random
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	27 import shutil
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	28 import struct
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	29 import sys
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	30 import tempfile
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	31 import threading
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	32 import time
330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	33 from mercurial import (
30020 bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	34 changegroup,
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	35 cmdutil,
330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	36 commands,
330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	37 copies,
330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	38 error,
29495 f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	39 extensions,
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	40 mdiff,
330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	41 merge,
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	42 revlog,
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	43 util,
330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	44 )
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	45
29494 3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	46 # for "historical portability":
29567 7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	47 # try to import modules separately (in dict order), and ignore
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	48 # failure, because these aren't available with early Mercurial
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	49 try:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	50 from mercurial import branchmap # since 2.5 (or bcee63733aad)
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	51 except ImportError:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	52 pass
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	53 try:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	54 from mercurial import obsolete # since 2.3 (or ad0d6c2b3279)
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	55 except ImportError:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	56 pass
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	57 try:
32376 46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	58 from mercurial import registrar # since 3.7 (or 37d50250b696)
46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	59 dir(registrar) # forcibly load it
46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	60 except ImportError:
46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	61 registrar = None
46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	62 try:
29567 7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	63 from mercurial import repoview # since 2.5 (or 3a6ddacb7198)
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	64 except ImportError:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	65 pass
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	66 try:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	67 from mercurial import scmutil # since 1.9 (or 8b252e826c68)
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	68 except ImportError:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	69 pass
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	70
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	71 def identity(a):
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	72 return a
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	73
36216 646002338365 py3: introduce and use pycompat.getargspec Augie Fackler <augie@google.com> parents: 35990 diff changeset	74 try:
646002338365 py3: introduce and use pycompat.getargspec Augie Fackler <augie@google.com> parents: 35990 diff changeset	75 from mercurial import pycompat
646002338365 py3: introduce and use pycompat.getargspec Augie Fackler <augie@google.com> parents: 35990 diff changeset	76 getargspec = pycompat.getargspec # added to module after 4.5
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	77 _byteskwargs = pycompat.byteskwargs # since 4.1 (or fbc3f73dc802)
39826 6787dc1b93a9 py3: handle sysstr conversion around get/set attr in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39779 diff changeset	78 _sysstr = pycompat.sysstr # since 4.0 (or 2219f4f82ede)
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	79 _xrange = pycompat.xrange # since 4.8 (or 7eba8f83129b)
40214 b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	80 fsencode = pycompat.fsencode # since 3.9 (or f4a5e0e86a7e)
39828 c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	81 if pycompat.ispy3:
c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	82 _maxint = sys.maxsize # per py3 docs for replacing maxint
c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	83 else:
c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	84 _maxint = sys.maxint
36216 646002338365 py3: introduce and use pycompat.getargspec Augie Fackler <augie@google.com> parents: 35990 diff changeset	85 except (ImportError, AttributeError):
646002338365 py3: introduce and use pycompat.getargspec Augie Fackler <augie@google.com> parents: 35990 diff changeset	86 import inspect
646002338365 py3: introduce and use pycompat.getargspec Augie Fackler <augie@google.com> parents: 35990 diff changeset	87 getargspec = inspect.getargspec
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	88 _byteskwargs = identity
40214 b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	89 fsencode = identity # no py3 support
39828 c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	90 _maxint = sys.maxint # no py3 support
39826 6787dc1b93a9 py3: handle sysstr conversion around get/set attr in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39779 diff changeset	91 _sysstr = lambda x: x # no py3 support
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	92 _xrange = xrange
29567 7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	93
37890 8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	94 try:
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	95 # 4.7+
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	96 queue = pycompat.queue.Queue
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	97 except (AttributeError, ImportError):
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	98 # <4.7.
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	99 try:
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	100 queue = pycompat.queue
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	101 except (AttributeError, ImportError):
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	102 queue = util.queue
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	103
38269 a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	104 try:
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	105 from mercurial import logcmdutil
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	106 makelogtemplater = logcmdutil.maketemplater
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	107 except (AttributeError, ImportError):
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	108 try:
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	109 makelogtemplater = cmdutil.makelogtemplater
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	110 except (AttributeError, ImportError):
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	111 makelogtemplater = None
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	112
29567 7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	113 # for "historical portability":
29494 3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	114 # define util.safehasattr forcibly, because util.safehasattr has been
3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	115 # available since 1.9.3 (or 94b200a11cf7)
3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	116 _undefined = object()
3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	117 def safehasattr(thing, attr):
39826 6787dc1b93a9 py3: handle sysstr conversion around get/set attr in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39779 diff changeset	118 return getattr(thing, _sysstr(attr), _undefined) is not _undefined
29494 3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	119 setattr(util, 'safehasattr', safehasattr)
3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	120
29496 7299370cf304 perf: avoid using formatteropts for Mercurial earlier than 3.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29495 diff changeset	121 # for "historical portability":
31823 f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	122 # define util.timer forcibly, because util.timer has been available
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	123 # since ae5d60bb70c9
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	124 if safehasattr(time, 'perf_counter'):
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	125 util.timer = time.perf_counter
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	126 elif os.name == b'nt':
31823 f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	127 util.timer = time.clock
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	128 else:
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	129 util.timer = time.time
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	130
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	131 # for "historical portability":
29496 7299370cf304 perf: avoid using formatteropts for Mercurial earlier than 3.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29495 diff changeset	132 # use locally defined empty option list, if formatteropts isn't
7299370cf304 perf: avoid using formatteropts for Mercurial earlier than 3.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29495 diff changeset	133 # available, because commands.formatteropts has been available since
7299370cf304 perf: avoid using formatteropts for Mercurial earlier than 3.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29495 diff changeset	134 # 3.2 (or 7a7eed5176a4), even though formatting itself has been
7299370cf304 perf: avoid using formatteropts for Mercurial earlier than 3.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29495 diff changeset	135 # available since 2.2 (or ae5f92e154d3)
32414 04baab18d60a commands: move templates of common command options to cmdutil (API) Yuya Nishihara <yuya@tcha.org> parents: 32376 diff changeset	136 formatteropts = getattr(cmdutil, "formatteropts",
04baab18d60a commands: move templates of common command options to cmdutil (API) Yuya Nishihara <yuya@tcha.org> parents: 32376 diff changeset	137 getattr(commands, "formatteropts", []))
29495 f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	138
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	139 # for "historical portability":
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	140 # use locally defined option list, if debugrevlogopts isn't available,
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	141 # because commands.debugrevlogopts has been available since 3.7 (or
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	142 # 5606f7d0d063), even though cmdutil.openrevlog() has been available
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	143 # since 1.9 (or a79fea6b3e77).
32414 04baab18d60a commands: move templates of common command options to cmdutil (API) Yuya Nishihara <yuya@tcha.org> parents: 32376 diff changeset	144 revlogopts = getattr(cmdutil, "debugrevlogopts",
04baab18d60a commands: move templates of common command options to cmdutil (API) Yuya Nishihara <yuya@tcha.org> parents: 32376 diff changeset	145 getattr(commands, "debugrevlogopts", [
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	146 (b'c', b'changelog', False, (b'open changelog')),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	147 (b'm', b'manifest', False, (b'open manifest')),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	148 (b'', b'dir', False, (b'open directory manifest')),
32414 04baab18d60a commands: move templates of common command options to cmdutil (API) Yuya Nishihara <yuya@tcha.org> parents: 32376 diff changeset	149 ]))
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	150
18237 4132dc9bd5c4 perftest: migrate to new style command declaration Pierre-Yves David <pierre-yves.david@ens-lyon.org> parents: 18236 diff changeset	151 cmdtable = {}
29497 ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	152
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	153 # for "historical portability":
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	154 # define parsealiases locally, because cmdutil.parsealiases has been
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	155 # available since 1.5 (or 6252852b4332)
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	156 def parsealiases(cmd):
40295 fa88170c10bb help: adding a proper declaration for shortlist/basic commands (API) Rodrigo Damazio <rdamazio@google.com> parents: 40214 diff changeset	157 return cmd.split(b"\|")
29497 ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	158
32376 46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	159 if safehasattr(registrar, 'command'):
46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	160 command = registrar.command(cmdtable)
46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	161 elif safehasattr(cmdutil, 'command'):
29497 ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	162 command = cmdutil.command(cmdtable)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	163 if b'norepo' not in getargspec(command).args:
29497 ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	164 # for "historical portability":
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	165 # wrap original cmdutil.command, because "norepo" option has
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	166 # been available since 3.1 (or 75a96326cecb)
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	167 _command = command
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	168 def command(name, options=(), synopsis=None, norepo=False):
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	169 if norepo:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	170 commands.norepo += b' %s' % b' '.join(parsealiases(name))
29497 ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	171 return _command(name, list(options), synopsis)
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	172 else:
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	173 # for "historical portability":
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	174 # define "@command" annotation locally, because cmdutil.command
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	175 # has been available since 1.9 (or 2daa5179e73f)
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	176 def command(name, options=(), synopsis=None, norepo=False):
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	177 def decorator(func):
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	178 if synopsis:
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	179 cmdtable[name] = func, list(options), synopsis
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	180 else:
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	181 cmdtable[name] = func, list(options)
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	182 if norepo:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	183 commands.norepo += b' %s' % b' '.join(parsealiases(name))
29497 ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	184 return func
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	185 return decorator
18237 4132dc9bd5c4 perftest: migrate to new style command declaration Pierre-Yves David <pierre-yves.david@ens-lyon.org> parents: 18236 diff changeset	186
34494 bbb5687e5140 configitems: register the 'perf.stub' config Boris Feld <boris.feld@octobus.net> parents: 34350 diff changeset	187 try:
34749 acdc574cb8d7 contrib-perf: update the config registration Boris Feld <boris.feld@octobus.net> parents: 34678 diff changeset	188 import mercurial.registrar
acdc574cb8d7 contrib-perf: update the config registration Boris Feld <boris.feld@octobus.net> parents: 34678 diff changeset	189 import mercurial.configitems
34494 bbb5687e5140 configitems: register the 'perf.stub' config Boris Feld <boris.feld@octobus.net> parents: 34350 diff changeset	190 configtable = {}
34749 acdc574cb8d7 contrib-perf: update the config registration Boris Feld <boris.feld@octobus.net> parents: 34678 diff changeset	191 configitem = mercurial.registrar.configitem(configtable)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	192 configitem(b'perf', b'presleep',
34749 acdc574cb8d7 contrib-perf: update the config registration Boris Feld <boris.feld@octobus.net> parents: 34678 diff changeset	193 default=mercurial.configitems.dynamicdefault,
acdc574cb8d7 contrib-perf: update the config registration Boris Feld <boris.feld@octobus.net> parents: 34678 diff changeset	194 )
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	195 configitem(b'perf', b'stub',
34749 acdc574cb8d7 contrib-perf: update the config registration Boris Feld <boris.feld@octobus.net> parents: 34678 diff changeset	196 default=mercurial.configitems.dynamicdefault,
34494 bbb5687e5140 configitems: register the 'perf.stub' config Boris Feld <boris.feld@octobus.net> parents: 34350 diff changeset	197 )
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	198 configitem(b'perf', b'parentscount',
34750 caf6c446cbe3 contrib-perf: register the 'parentscount' config item Boris Feld <boris.feld@octobus.net> parents: 34749 diff changeset	199 default=mercurial.configitems.dynamicdefault,
caf6c446cbe3 contrib-perf: register the 'parentscount' config item Boris Feld <boris.feld@octobus.net> parents: 34749 diff changeset	200 )
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	201 configitem(b'perf', b'all-timing',
38694 55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	202 default=mercurial.configitems.dynamicdefault,
55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	203 )
34494 bbb5687e5140 configitems: register the 'perf.stub' config Boris Feld <boris.feld@octobus.net> parents: 34350 diff changeset	204 except (ImportError, AttributeError):
bbb5687e5140 configitems: register the 'perf.stub' config Boris Feld <boris.feld@octobus.net> parents: 34350 diff changeset	205 pass
bbb5687e5140 configitems: register the 'perf.stub' config Boris Feld <boris.feld@octobus.net> parents: 34350 diff changeset	206
27307 f36dc0062b1a perf: add getlen timeless <timeless@mozdev.org> parents: 27306 diff changeset	207 def getlen(ui):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	208 if ui.configbool(b"perf", b"stub", False):
27307 f36dc0062b1a perf: add getlen timeless <timeless@mozdev.org> parents: 27306 diff changeset	209 return lambda x: 1
f36dc0062b1a perf: add getlen timeless <timeless@mozdev.org> parents: 27306 diff changeset	210 return len
f36dc0062b1a perf: add getlen timeless <timeless@mozdev.org> parents: 27306 diff changeset	211
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	212 def gettimer(ui, opts=None):
8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	213 """return a timer function and formatter: (timer, formatter)
8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	214
27303 57bd9c5431a5 perf: improve grammar of gettimer comment timeless <timeless@mozdev.org> parents: 27286 diff changeset	215 This function exists to gather the creation of formatter in a single
57bd9c5431a5 perf: improve grammar of gettimer comment timeless <timeless@mozdev.org> parents: 27286 diff changeset	216 place instead of duplicating it in all performance commands."""
23788 316ad725a1dd perf: add a configurable sleep on startup Matt Mackall <mpm@selenic.com> parents: 23537 diff changeset	217
316ad725a1dd perf: add a configurable sleep on startup Matt Mackall <mpm@selenic.com> parents: 23537 diff changeset	218 # enforce an idle period before execution to counteract power management
25850 b130764e3eb5 perf: mark experimental option presleep Matt Mackall <mpm@selenic.com> parents: 25494 diff changeset	219 # experimental config: perf.presleep
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	220 time.sleep(getint(ui, b"perf", b"presleep", 1))
23788 316ad725a1dd perf: add a configurable sleep on startup Matt Mackall <mpm@selenic.com> parents: 23537 diff changeset	221
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	222 if opts is None:
8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	223 opts = {}
30415 e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	224 # redirect all to stderr unless buffer api is in use
e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	225 if not ui._buffers:
e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	226 ui = ui.copy()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	227 uifout = safeattrsetter(ui, b'fout', ignoremissing=True)
30415 e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	228 if uifout:
e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	229 # for "historical portability":
e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	230 # ui.fout/ferr have been available since 1.9 (or 4e1ccd4c2b6d)
e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	231 uifout.set(ui.ferr)
30147 423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	232
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	233 # get a formatter
30147 423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	234 uiformatter = getattr(ui, 'formatter', None)
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	235 if uiformatter:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	236 fm = uiformatter(b'perf', opts)
30147 423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	237 else:
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	238 # for "historical portability":
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	239 # define formatter locally, because ui.formatter has been
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	240 # available since 2.2 (or ae5f92e154d3)
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	241 from mercurial import node
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	242 class defaultformatter(object):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	243 """Minimized composition of baseformatter and plainformatter
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	244 """
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	245 def __init__(self, ui, topic, opts):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	246 self._ui = ui
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	247 if ui.debugflag:
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	248 self.hexfunc = node.hex
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	249 else:
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	250 self.hexfunc = node.short
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	251 def __nonzero__(self):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	252 return False
31483 413b44003462 py3: add __bool__ to every class defining __nonzero__ Gregory Szorc <gregory.szorc@gmail.com> parents: 31406 diff changeset	253 __bool__ = __nonzero__
30147 423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	254 def startitem(self):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	255 pass
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	256 def data(self, **data):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	257 pass
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	258 def write(self, fields, deftext, fielddata, *opts):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	259 self._ui.write(deftext % fielddata, **opts)
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	260 def condwrite(self, cond, fields, deftext, fielddata, *opts):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	261 if cond:
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	262 self._ui.write(deftext % fielddata, **opts)
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	263 def plain(self, text, **opts):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	264 self._ui.write(text, **opts)
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	265 def end(self):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	266 pass
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	267 fm = defaultformatter(ui, b'perf', opts)
30147 423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	268
27304 a6fd79495770 perf: offer perf.stub to only run one loop timeless <timeless@mozdev.org> parents: 27303 diff changeset	269 # stub function, runs code only once instead of in a loop
a6fd79495770 perf: offer perf.stub to only run one loop timeless <timeless@mozdev.org> parents: 27303 diff changeset	270 # experimental config: perf.stub
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	271 if ui.configbool(b"perf", b"stub", False):
27304 a6fd79495770 perf: offer perf.stub to only run one loop timeless <timeless@mozdev.org> parents: 27303 diff changeset	272 return functools.partial(stub_timer, fm), fm
38694 55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	273
55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	274 # experimental config: perf.all-timing
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	275 displayall = ui.configbool(b"perf", b"all-timing", False)
38694 55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	276 return functools.partial(_timer, fm, displayall=displayall), fm
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	277
27304 a6fd79495770 perf: offer perf.stub to only run one loop timeless <timeless@mozdev.org> parents: 27303 diff changeset	278 def stub_timer(fm, func, title=None):
a6fd79495770 perf: offer perf.stub to only run one loop timeless <timeless@mozdev.org> parents: 27303 diff changeset	279 func()
a6fd79495770 perf: offer perf.stub to only run one loop timeless <timeless@mozdev.org> parents: 27303 diff changeset	280
40144 acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	281 @contextlib.contextmanager
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	282 def timeone():
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	283 r = []
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	284 ostart = os.times()
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	285 cstart = util.timer()
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	286 yield r
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	287 cstop = util.timer()
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	288 ostop = os.times()
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	289 a, b = ostart, ostop
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	290 r.append((cstop - cstart, b[0] - a[0], b[1]-a[1]))
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	291
38694 55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	292 def _timer(fm, func, title=None, displayall=False):
31406 8f5ed8fa39f8 perf: perform a garbage collection before each iteration Gregory Szorc <gregory.szorc@gmail.com> parents: 30997 diff changeset	293 gc.collect()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	294 results = []
30995 22fbca1d11ed mercurial: switch to util.timer for all interval timings Simon Farnsworth <simonfar@fb.com> parents: 30914 diff changeset	295 begin = util.timer()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	296 count = 0
14494 1ffeeb91c55d check-code: flag 0/1 used as constant Boolean expression Martin Geisler <mg@lazybytes.net> parents: 14322 diff changeset	297 while True:
40144 acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	298 with timeone() as item:
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	299 r = func()
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	300 count += 1
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	301 results.append(item[0])
30995 22fbca1d11ed mercurial: switch to util.timer for all interval timings Simon Farnsworth <simonfar@fb.com> parents: 30914 diff changeset	302 cstop = util.timer()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	303 if cstop - begin > 3 and count >= 100:
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	304 break
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	305 if cstop - begin > 10 and count >= 3:
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	306 break
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	307
40145 21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	308 formatone(fm, results, title=title, result=r,
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	309 displayall=displayall)
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	310
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	311 def formatone(fm, timings, title=None, result=None, displayall=False):
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	312
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	313 count = len(timings)
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	314
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	315 fm.startitem()
8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	316
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	317 if title:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	318 fm.write(b'title', b'! %s\n', title)
40145 21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	319 if result:
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	320 fm.write(b'result', b'! result: %s\n', result)
38694 55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	321 def display(role, entry):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	322 prefix = b''
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	323 if role != b'best':
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	324 prefix = b'%s.' % role
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	325 fm.plain(b'!')
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	326 fm.write(prefix + b'wall', b' wall %f', entry[0])
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	327 fm.write(prefix + b'comb', b' comb %f', entry[1] + entry[2])
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	328 fm.write(prefix + b'user', b' user %f', entry[1])
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	329 fm.write(prefix + b'sys', b' sys %f', entry[2])
40141 8643219146e1 perf: fix -T json Boris Feld <boris.feld@octobus.net> parents: 39830 diff changeset	330 fm.write(prefix + b'count', b' (%s of %%d)' % role, count)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	331 fm.plain(b'\n')
40145 21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	332 timings.sort()
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	333 min_val = timings[0]
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	334 display(b'best', min_val)
38694 55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	335 if displayall:
40145 21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	336 max_val = timings[-1]
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	337 display(b'max', max_val)
40145 21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	338 avg = tuple([sum(x) / count for x in zip(*timings)])
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	339 display(b'avg', avg)
40145 21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	340 median = timings[len(timings) // 2]
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	341 display(b'median', median)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	342
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	343 # utilities for historical portability
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	344
30149 d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	345 def getint(ui, section, name, default):
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	346 # for "historical portability":
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	347 # ui.configint has been available since 1.9 (or fa2b596db182)
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	348 v = ui.config(section, name, None)
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	349 if v is None:
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	350 return default
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	351 try:
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	352 return int(v)
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	353 except ValueError:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	354 raise error.ConfigError((b"%s.%s is not an integer ('%s')")
30149 d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	355 % (section, name, v))
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	356
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	357 def safeattrsetter(obj, name, ignoremissing=False):
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	358 """Ensure that 'obj' has 'name' attribute before subsequent setattr
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	359
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	360 This function is aborted, if 'obj' doesn't have 'name' attribute
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	361 at runtime. This avoids overlooking removal of an attribute, which
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	362 breaks assumption of performance measurement, in the future.
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	363
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	364 This function returns the object to (1) assign a new value, and
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	365 (2) restore an original value to the attribute.
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	366
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	367 If 'ignoremissing' is true, missing 'name' attribute doesn't cause
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	368 abortion, and this function returns None. This is useful to
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	369 examine an attribute, which isn't ensured in all Mercurial
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	370 versions.
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	371 """
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	372 if not util.safehasattr(obj, name):
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	373 if ignoremissing:
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	374 return None
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	375 raise error.Abort((b"missing attribute %s of %s might break assumption"
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	376 b" of performance measurement") % (name, obj))
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	377
39826 6787dc1b93a9 py3: handle sysstr conversion around get/set attr in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39779 diff changeset	378 origvalue = getattr(obj, _sysstr(name))
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	379 class attrutil(object):
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	380 def set(self, newvalue):
39826 6787dc1b93a9 py3: handle sysstr conversion around get/set attr in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39779 diff changeset	381 setattr(obj, _sysstr(name), newvalue)
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	382 def restore(self):
39826 6787dc1b93a9 py3: handle sysstr conversion around get/set attr in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39779 diff changeset	383 setattr(obj, _sysstr(name), origvalue)
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	384
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	385 return attrutil()
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	386
30144 14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	387 # utilities to examine each internal API changes
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	388
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	389 def getbranchmapsubsettable():
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	390 # for "historical portability":
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	391 # subsettable is defined in:
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	392 # - branchmap since 2.9 (or 175c6fd8cacc)
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	393 # - repoview since 2.5 (or 59a9f18d4587)
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	394 for mod in (branchmap, repoview):
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	395 subsettable = getattr(mod, 'subsettable', None)
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	396 if subsettable:
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	397 return subsettable
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	398
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	399 # bisecting in bcee63733aad::59a9f18d4587 can reach here (both
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	400 # branchmap and repoview modules exist, but subsettable attribute
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	401 # doesn't)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	402 raise error.Abort((b"perfbranchmap not available with this Mercurial"),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	403 hint=b"use 2.5 or later")
30144 14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	404
30146 148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	405 def getsvfs(repo):
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	406 """Return appropriate object to access files under .hg/store
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	407 """
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	408 # for "historical portability":
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	409 # repo.svfs has been available since 2.3 (or 7034365089bf)
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	410 svfs = getattr(repo, 'svfs', None)
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	411 if svfs:
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	412 return svfs
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	413 else:
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	414 return getattr(repo, 'sopener')
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	415
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	416 def getvfs(repo):
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	417 """Return appropriate object to access files under .hg
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	418 """
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	419 # for "historical portability":
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	420 # repo.vfs has been available since 2.3 (or 7034365089bf)
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	421 vfs = getattr(repo, 'vfs', None)
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	422 if vfs:
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	423 return vfs
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	424 else:
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	425 return getattr(repo, 'opener')
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	426
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	427 def repocleartagscachefunc(repo):
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	428 """Return the function to clear tags cache according to repo internal API
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	429 """
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	430 if util.safehasattr(repo, b'_tagscache'): # since 2.0 (or 9dca7653b525)
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	431 # in this case, setattr(repo, '_tagscache', None) or so isn't
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	432 # correct way to clear tags cache, because existing code paths
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	433 # expect _tagscache to be a structured object.
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	434 def clearcache():
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	435 # _tagscache has been filteredpropertycache since 2.5 (or
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	436 # 98c867ac1330), and delattr() can't work in such case
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	437 if b'_tagscache' in vars(repo):
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	438 del repo.__dict__[b'_tagscache']
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	439 return clearcache
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	440
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	441 repotags = safeattrsetter(repo, b'_tags', ignoremissing=True)
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	442 if repotags: # since 1.4 (or 5614a628d173)
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	443 return lambda : repotags.set(None)
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	444
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	445 repotagscache = safeattrsetter(repo, b'tagscache', ignoremissing=True)
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	446 if repotagscache: # since 0.6 (or d7df759d0e97)
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	447 return lambda : repotagscache.set(None)
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	448
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	449 # Mercurial earlier than 0.6 (or d7df759d0e97) logically reaches
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	450 # this point, but it isn't so problematic, because:
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	451 # - repo.tags of such Mercurial isn't "callable", and repo.tags()
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	452 # in perftags() causes failure soon
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	453 # - perf.py itself has been available since 1.1 (or eb240755386d)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	454 raise error.Abort((b"tags API of this hg command is unknown"))
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	455
32751 6f791ca70640 perf: have a generic "clearstorecache" function Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32730 diff changeset	456 # utilities to clear cache
6f791ca70640 perf: have a generic "clearstorecache" function Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32730 diff changeset	457
6f791ca70640 perf: have a generic "clearstorecache" function Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32730 diff changeset	458 def clearfilecache(repo, attrname):
6f791ca70640 perf: have a generic "clearstorecache" function Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32730 diff changeset	459 unfi = repo.unfiltered()
6f791ca70640 perf: have a generic "clearstorecache" function Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32730 diff changeset	460 if attrname in vars(unfi):
6f791ca70640 perf: have a generic "clearstorecache" function Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32730 diff changeset	461 delattr(unfi, attrname)
6f791ca70640 perf: have a generic "clearstorecache" function Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32730 diff changeset	462 unfi._filecache.pop(attrname, None)
6f791ca70640 perf: have a generic "clearstorecache" function Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32730 diff changeset	463
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	464 # perf commands
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	465
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	466 @command(b'perfwalk', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	467 def perfwalk(ui, repo, pats, *opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	468 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	469 timer, fm = gettimer(ui, opts)
34349 b3538c03a804 perf: remove fallbacks to ancient versions of dirstate.walk() Martin von Zweigbergk <martinvonz@google.com> parents: 32906 diff changeset	470 m = scmutil.match(repo[None], pats, {})
34350 255c761a52db dirstate: use keyword arguments to clarify walk()'s callers Martin von Zweigbergk <martinvonz@google.com> parents: 34349 diff changeset	471 timer(lambda: len(list(repo.dirstate.walk(m, subrepos=[], unknown=True,
255c761a52db dirstate: use keyword arguments to clarify walk()'s callers Martin von Zweigbergk <martinvonz@google.com> parents: 34349 diff changeset	472 ignored=False))))
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	473 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	474
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	475 @command(b'perfannotate', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	476 def perfannotate(ui, repo, f, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	477 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	478 timer, fm = gettimer(ui, opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	479 fc = repo[b'.'][f]
19292 e0aa6fff8f02 annotate: simplify annotate parent function Durham Goode <durham@fb.com> parents: 18877 diff changeset	480 timer(lambda: len(fc.annotate(True)))
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	481 fm.end()
19292 e0aa6fff8f02 annotate: simplify annotate parent function Durham Goode <durham@fb.com> parents: 18877 diff changeset	482
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	483 @command(b'perfstatus',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	484 [(b'u', b'unknown', False,
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	485 b'ask status to look for unknown files')] + formatteropts)
18033 00ac420f24ee perf: add option to perfstatus to get the status of unknown files Siddharth Agarwal <sid0@fb.com> parents: 17780 diff changeset	486 def perfstatus(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	487 opts = _byteskwargs(opts)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	488 #m = match.always(repo.root, repo.getcwd())
16683 525fdb738975 cleanup: eradicate long lines Brodie Rao <brodie@sf.io> parents: 16414 diff changeset	489 #timer(lambda: sum(map(len, repo.dirstate.status(m, [], False, False,
525fdb738975 cleanup: eradicate long lines Brodie Rao <brodie@sf.io> parents: 16414 diff changeset	490 # False))))
27017 cdc3e437b481 perf: un-bitrot perfstatus Matt Mackall <mpm@selenic.com> parents: 26748 diff changeset	491 timer, fm = gettimer(ui, opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	492 timer(lambda: sum(map(len, repo.status(unknown=opts[b'unknown']))))
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	493 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	494
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	495 @command(b'perfaddremove', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	496 def perfaddremove(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	497 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	498 timer, fm = gettimer(ui, opts)
18871 a2d4ab4f575d perf: add a command to test addremove performance Siddharth Agarwal <sid0@fb.com> parents: 18845 diff changeset	499 try:
a2d4ab4f575d perf: add a command to test addremove performance Siddharth Agarwal <sid0@fb.com> parents: 18845 diff changeset	500 oldquiet = repo.ui.quiet
a2d4ab4f575d perf: add a command to test addremove performance Siddharth Agarwal <sid0@fb.com> parents: 18845 diff changeset	501 repo.ui.quiet = True
23533 891aaa7c0c70 scmutil: pass a matcher to scmutil.addremove() instead of a list of patterns Matt Harbison <matt_harbison@yahoo.com> parents: 23485 diff changeset	502 matcher = scmutil.match(repo[None])
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	503 opts[b'dry_run'] = True
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	504 timer(lambda: scmutil.addremove(repo, matcher, b"", opts))
18871 a2d4ab4f575d perf: add a command to test addremove performance Siddharth Agarwal <sid0@fb.com> parents: 18845 diff changeset	505 finally:
a2d4ab4f575d perf: add a command to test addremove performance Siddharth Agarwal <sid0@fb.com> parents: 18845 diff changeset	506 repo.ui.quiet = oldquiet
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	507 fm.end()
18871 a2d4ab4f575d perf: add a command to test addremove performance Siddharth Agarwal <sid0@fb.com> parents: 18845 diff changeset	508
16785 1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	509 def clearcaches(cl):
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	510 # behave somewhat consistently across internal API changes
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	511 if util.safehasattr(cl, b'clearcaches'):
16785 1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	512 cl.clearcaches()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	513 elif util.safehasattr(cl, b'_nodecache'):
16785 1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	514 from mercurial.node import nullid, nullrev
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	515 cl._nodecache = {nullid: nullrev}
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	516 cl._nodepos = None
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	517
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	518 @command(b'perfheads', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	519 def perfheads(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	520 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	521 timer, fm = gettimer(ui, opts)
16785 1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	522 cl = repo.changelog
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	523 def d():
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	524 len(cl.headrevs())
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	525 clearcaches(cl)
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	526 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	527 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	528
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	529 @command(b'perftags', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	530 def perftags(ui, repo, **opts):
19786 fe8795dee77d perf: rearrange imports of changelong and manifest to appease check-code Augie Fackler <raf@durin42.com> parents: 19712 diff changeset	531 import mercurial.changelog
fe8795dee77d perf: rearrange imports of changelong and manifest to appease check-code Augie Fackler <raf@durin42.com> parents: 19712 diff changeset	532 import mercurial.manifest
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	533
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	534 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	535 timer, fm = gettimer(ui, opts)
30146 148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	536 svfs = getsvfs(repo)
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	537 repocleartagscache = repocleartagscachefunc(repo)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	538 def t():
30146 148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	539 repo.changelog = mercurial.changelog.changelog(svfs)
39779 5ccd791344f3 localrepo: pass root manifest into manifestlog.__init__ Gregory Szorc <gregory.szorc@gmail.com> parents: 39584 diff changeset	540 rootmanifest = mercurial.manifest.manifestrevlog(svfs)
5ccd791344f3 localrepo: pass root manifest into manifestlog.__init__ Gregory Szorc <gregory.szorc@gmail.com> parents: 39584 diff changeset	541 repo.manifestlog = mercurial.manifest.manifestlog(svfs, repo,
5ccd791344f3 localrepo: pass root manifest into manifestlog.__init__ Gregory Szorc <gregory.szorc@gmail.com> parents: 39584 diff changeset	542 rootmanifest)
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	543 repocleartagscache()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	544 return len(repo.tags())
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	545 timer(t)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	546 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	547
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	548 @command(b'perfancestors', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	549 def perfancestors(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	550 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	551 timer, fm = gettimer(ui, opts)
16802 7e5d94381cd1 perf: add a perfancestors benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16788 diff changeset	552 heads = repo.changelog.headrevs()
7e5d94381cd1 perf: add a perfancestors benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16788 diff changeset	553 def d():
16866 91f3ac205816 revlog: ancestors(revs) becomes ancestors(revs) (API) Bryan O'Sullivan <bryano@fb.com>* parents: 16858 diff changeset	554 for a in repo.changelog.ancestors(heads):
16802 7e5d94381cd1 perf: add a perfancestors benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16788 diff changeset	555 pass
7e5d94381cd1 perf: add a perfancestors benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16788 diff changeset	556 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	557 fm.end()
16802 7e5d94381cd1 perf: add a perfancestors benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16788 diff changeset	558
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	559 @command(b'perfancestorset', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	560 def perfancestorset(ui, repo, revset, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	561 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	562 timer, fm = gettimer(ui, opts)
18080 486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	563 revs = repo.revs(revset)
486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	564 heads = repo.changelog.headrevs()
486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	565 def d():
18091 f7f8159caad3 ancestor: add lazy membership testing to lazyancestors Siddharth Agarwal <sid0@fb.com> parents: 18080 diff changeset	566 s = repo.changelog.ancestors(heads)
18080 486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	567 for rev in revs:
486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	568 rev in s
486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	569 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	570 fm.end()
18080 486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	571
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	572 @command(b'perfbookmarks', formatteropts)
32753 2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	573 def perfbookmarks(ui, repo, **opts):
2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	574 """benchmark parsing bookmarks from disk to memory"""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	575 opts = _byteskwargs(opts)
32753 2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	576 timer, fm = gettimer(ui, opts)
2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	577 def d():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	578 clearfilecache(repo, b'_bookmarks')
32753 2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	579 repo._bookmarks
2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	580 timer(d)
2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	581 fm.end()
2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	582
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	583 @command(b'perfbundleread', formatteropts, b'BUNDLE')
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	584 def perfbundleread(ui, repo, bundlepath, **opts):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	585 """Benchmark reading of bundle files.
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	586
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	587 This command is meant to isolate the I/O part of bundle reading as
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	588 much as possible.
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	589 """
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	590 from mercurial import (
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	591 bundle2,
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	592 exchange,
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	593 streamclone,
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	594 )
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	595
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	596 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	597
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	598 def makebench(fn):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	599 def run():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	600 with open(bundlepath, b'rb') as fh:
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	601 bundle = exchange.readbundle(ui, fh, bundlepath)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	602 fn(bundle)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	603
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	604 return run
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	605
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	606 def makereadnbytes(size):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	607 def run():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	608 with open(bundlepath, b'rb') as fh:
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	609 bundle = exchange.readbundle(ui, fh, bundlepath)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	610 while bundle.read(size):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	611 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	612
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	613 return run
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	614
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	615 def makestdioread(size):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	616 def run():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	617 with open(bundlepath, b'rb') as fh:
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	618 while fh.read(size):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	619 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	620
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	621 return run
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	622
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	623 # bundle1
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	624
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	625 def deltaiter(bundle):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	626 for delta in bundle.deltaiter():
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	627 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	628
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	629 def iterchunks(bundle):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	630 for chunk in bundle.getchunks():
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	631 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	632
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	633 # bundle2
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	634
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	635 def forwardchunks(bundle):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	636 for chunk in bundle._forwardchunks():
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	637 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	638
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	639 def iterparts(bundle):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	640 for part in bundle.iterparts():
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	641 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	642
35137 da91e7309daf bundle2: don't use seekable bundle2 parts by default (issue5691) Gregory Szorc <gregory.szorc@gmail.com> parents: 35132 diff changeset	643 def iterpartsseekable(bundle):
da91e7309daf bundle2: don't use seekable bundle2 parts by default (issue5691) Gregory Szorc <gregory.szorc@gmail.com> parents: 35132 diff changeset	644 for part in bundle.iterparts(seekable=True):
da91e7309daf bundle2: don't use seekable bundle2 parts by default (issue5691) Gregory Szorc <gregory.szorc@gmail.com> parents: 35132 diff changeset	645 pass
da91e7309daf bundle2: don't use seekable bundle2 parts by default (issue5691) Gregory Szorc <gregory.szorc@gmail.com> parents: 35132 diff changeset	646
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	647 def seek(bundle):
35137 da91e7309daf bundle2: don't use seekable bundle2 parts by default (issue5691) Gregory Szorc <gregory.szorc@gmail.com> parents: 35132 diff changeset	648 for part in bundle.iterparts(seekable=True):
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	649 part.seek(0, os.SEEK_END)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	650
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	651 def makepartreadnbytes(size):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	652 def run():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	653 with open(bundlepath, b'rb') as fh:
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	654 bundle = exchange.readbundle(ui, fh, bundlepath)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	655 for part in bundle.iterparts():
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	656 while part.read(size):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	657 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	658
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	659 return run
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	660
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	661 benches = [
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	662 (makestdioread(8192), b'read(8k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	663 (makestdioread(16384), b'read(16k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	664 (makestdioread(32768), b'read(32k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	665 (makestdioread(131072), b'read(128k)'),
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	666 ]
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	667
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	668 with open(bundlepath, b'rb') as fh:
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	669 bundle = exchange.readbundle(ui, fh, bundlepath)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	670
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	671 if isinstance(bundle, changegroup.cg1unpacker):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	672 benches.extend([
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	673 (makebench(deltaiter), b'cg1 deltaiter()'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	674 (makebench(iterchunks), b'cg1 getchunks()'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	675 (makereadnbytes(8192), b'cg1 read(8k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	676 (makereadnbytes(16384), b'cg1 read(16k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	677 (makereadnbytes(32768), b'cg1 read(32k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	678 (makereadnbytes(131072), b'cg1 read(128k)'),
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	679 ])
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	680 elif isinstance(bundle, bundle2.unbundle20):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	681 benches.extend([
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	682 (makebench(forwardchunks), b'bundle2 forwardchunks()'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	683 (makebench(iterparts), b'bundle2 iterparts()'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	684 (makebench(iterpartsseekable), b'bundle2 iterparts() seekable'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	685 (makebench(seek), b'bundle2 part seek()'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	686 (makepartreadnbytes(8192), b'bundle2 part read(8k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	687 (makepartreadnbytes(16384), b'bundle2 part read(16k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	688 (makepartreadnbytes(32768), b'bundle2 part read(32k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	689 (makepartreadnbytes(131072), b'bundle2 part read(128k)'),
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	690 ])
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	691 elif isinstance(bundle, streamclone.streamcloneapplier):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	692 raise error.Abort(b'stream clone bundles not supported')
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	693 else:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	694 raise error.Abort(b'unhandled bundle type: %s' % type(bundle))
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	695
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	696 for fn, title in benches:
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	697 timer, fm = gettimer(ui, opts)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	698 timer(fn, title=title)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	699 fm.end()
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	700
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	701 @command(b'perfchangegroupchangelog', formatteropts +
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	702 [(b'', b'version', b'02', b'changegroup version'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	703 (b'r', b'rev', b'', b'revisions to add to changegroup')])
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	704 def perfchangegroupchangelog(ui, repo, version=b'02', rev=None, **opts):
30020 bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	705 """Benchmark producing a changelog group for a changegroup.
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	706
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	707 This measures the time spent processing the changelog during a
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	708 bundle operation. This occurs during `hg bundle` and on a server
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	709 processing a `getbundle` wire protocol request (handles clones
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	710 and pull requests).
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	711
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	712 By default, all revisions are added to the changegroup.
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	713 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	714 opts = _byteskwargs(opts)
30020 bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	715 cl = repo.changelog
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	716 nodes = [cl.lookup(r) for r in repo.revs(rev or b'all()')]
30020 bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	717 bundler = changegroup.getbundler(version, repo)
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	718
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	719 def d():
39015 a1f694779b2f perf: call _generatechangelog() instead of group() Gregory Szorc <gregory.szorc@gmail.com> parents: 39007 diff changeset	720 state, chunks = bundler._generatechangelog(cl, nodes)
a1f694779b2f perf: call _generatechangelog() instead of group() Gregory Szorc <gregory.szorc@gmail.com> parents: 39007 diff changeset	721 for chunk in chunks:
30020 bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	722 pass
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	723
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	724 timer, fm = gettimer(ui, opts)
39015 a1f694779b2f perf: call _generatechangelog() instead of group() Gregory Szorc <gregory.szorc@gmail.com> parents: 39007 diff changeset	725
a1f694779b2f perf: call _generatechangelog() instead of group() Gregory Szorc <gregory.szorc@gmail.com> parents: 39007 diff changeset	726 # Terminal printing can interfere with timing. So disable it.
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	727 with ui.configoverride({(b'progress', b'disable'): True}):
39015 a1f694779b2f perf: call _generatechangelog() instead of group() Gregory Szorc <gregory.szorc@gmail.com> parents: 39007 diff changeset	728 timer(d)
a1f694779b2f perf: call _generatechangelog() instead of group() Gregory Szorc <gregory.szorc@gmail.com> parents: 39007 diff changeset	729
30020 bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	730 fm.end()
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	731
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	732 @command(b'perfdirs', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	733 def perfdirs(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	734 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	735 timer, fm = gettimer(ui, opts)
18845 c1f416e4bc80 perf: add perfdirs command Bryan O'Sullivan <bryano@fb.com> parents: 18837 diff changeset	736 dirstate = repo.dirstate
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	737 b'a' in dirstate
18845 c1f416e4bc80 perf: add perfdirs command Bryan O'Sullivan <bryano@fb.com> parents: 18837 diff changeset	738 def d():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	739 dirstate.hasdir(b'a')
35107 61888bd0b300 dirstate: add explicit methods for querying directories (API) Mark Thomas <mbthomas@fb.com> parents: 34750 diff changeset	740 del dirstate._map._dirs
18845 c1f416e4bc80 perf: add perfdirs command Bryan O'Sullivan <bryano@fb.com> parents: 18837 diff changeset	741 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	742 fm.end()
18845 c1f416e4bc80 perf: add perfdirs command Bryan O'Sullivan <bryano@fb.com> parents: 18837 diff changeset	743
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	744 @command(b'perfdirstate', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	745 def perfdirstate(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	746 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	747 timer, fm = gettimer(ui, opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	748 b"a" in repo.dirstate
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	749 def d():
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	750 repo.dirstate.invalidate()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	751 b"a" in repo.dirstate
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	752 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	753 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	754
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	755 @command(b'perfdirstatedirs', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	756 def perfdirstatedirs(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	757 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	758 timer, fm = gettimer(ui, opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	759 b"a" in repo.dirstate
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	760 def d():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	761 repo.dirstate.hasdir(b"a")
35107 61888bd0b300 dirstate: add explicit methods for querying directories (API) Mark Thomas <mbthomas@fb.com> parents: 34750 diff changeset	762 del repo.dirstate._map._dirs
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	763 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	764 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	765
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	766 @command(b'perfdirstatefoldmap', formatteropts)
27095 aaf4e2d77148 contrib/perf: name functions to match decorators timeless <timeless@mozdev.org> parents: 27072 diff changeset	767 def perfdirstatefoldmap(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	768 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	769 timer, fm = gettimer(ui, opts)
22780 d8ff1f671aed perf: add a way to measure the perf of constructing the foldmap Siddharth Agarwal <sid0@fb.com> parents: 20846 diff changeset	770 dirstate = repo.dirstate
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	771 b'a' in dirstate
22780 d8ff1f671aed perf: add a way to measure the perf of constructing the foldmap Siddharth Agarwal <sid0@fb.com> parents: 20846 diff changeset	772 def d():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	773 dirstate._map.filefoldmap.get(b'a')
34676 bfddc3d678ae dirstate: remove _filefoldmap property cache Durham Goode <durham@fb.com> parents: 34494 diff changeset	774 del dirstate._map.filefoldmap
24607 f5b527024fcc perf: make measuring foldmap perf work again Siddharth Agarwal <sid0@fb.com> parents: 24349 diff changeset	775 timer(d)
f5b527024fcc perf: make measuring foldmap perf work again Siddharth Agarwal <sid0@fb.com> parents: 24349 diff changeset	776 fm.end()
f5b527024fcc perf: make measuring foldmap perf work again Siddharth Agarwal <sid0@fb.com> parents: 24349 diff changeset	777
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	778 @command(b'perfdirfoldmap', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	779 def perfdirfoldmap(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	780 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	781 timer, fm = gettimer(ui, opts)
24607 f5b527024fcc perf: make measuring foldmap perf work again Siddharth Agarwal <sid0@fb.com> parents: 24349 diff changeset	782 dirstate = repo.dirstate
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	783 b'a' in dirstate
24607 f5b527024fcc perf: make measuring foldmap perf work again Siddharth Agarwal <sid0@fb.com> parents: 24349 diff changeset	784 def d():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	785 dirstate._map.dirfoldmap.get(b'a')
34678 e8a89ed7ce96 dirstate: move the _dirfoldmap to dirstatemap Durham Goode <durham@fb.com> parents: 34677 diff changeset	786 del dirstate._map.dirfoldmap
35107 61888bd0b300 dirstate: add explicit methods for querying directories (API) Mark Thomas <mbthomas@fb.com> parents: 34750 diff changeset	787 del dirstate._map._dirs
22780 d8ff1f671aed perf: add a way to measure the perf of constructing the foldmap Siddharth Agarwal <sid0@fb.com> parents: 20846 diff changeset	788 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	789 fm.end()
22780 d8ff1f671aed perf: add a way to measure the perf of constructing the foldmap Siddharth Agarwal <sid0@fb.com> parents: 20846 diff changeset	790
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	791 @command(b'perfdirstatewrite', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	792 def perfdirstatewrite(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	793 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	794 timer, fm = gettimer(ui, opts)
16788 7e72c1609862 perf: add a perfdirstatewrite benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16785 diff changeset	795 ds = repo.dirstate
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	796 b"a" in ds
16788 7e72c1609862 perf: add a perfdirstatewrite benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16785 diff changeset	797 def d():
7e72c1609862 perf: add a perfdirstatewrite benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16785 diff changeset	798 ds._dirty = True
26748 5ba0a99ff27f dirstate: make dirstate.write() callers pass transaction object to it FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25850 diff changeset	799 ds.write(repo.currenttransaction())
16788 7e72c1609862 perf: add a perfdirstatewrite benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16785 diff changeset	800 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	801 fm.end()
16788 7e72c1609862 perf: add a perfdirstatewrite benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16785 diff changeset	802
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	803 @command(b'perfmergecalculate',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	804 [(b'r', b'rev', b'.', b'rev to merge against')] + formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	805 def perfmergecalculate(ui, repo, rev, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	806 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	807 timer, fm = gettimer(ui, opts)
18817 c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	808 wctx = repo[None]
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	809 rctx = scmutil.revsingle(repo, rev, rev)
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	810 ancestor = wctx.ancestor(rctx)
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	811 # we don't want working dir files to be stat'd in the benchmark, so prime
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	812 # that cache
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	813 wctx.dirty()
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	814 def d():
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	815 # acceptremote is True because we don't want prompts in the middle of
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	816 # our benchmark
27098 64cb281d23a5 contrib/perf: fix perfmergecalculate timeless <timeless@mozdev.org> parents: 27097 diff changeset	817 merge.calculateupdates(repo, wctx, rctx, [ancestor], False, False,
27345 98266b1d144d merge: restate calculateupdates in terms of a matcher Augie Fackler <augie@google.com> parents: 27308 diff changeset	818 acceptremote=True, followcopies=True)
18817 c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	819 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	820 fm.end()
18817 c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	821
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	822 @command(b'perfpathcopies', [], b"REV REV")
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	823 def perfpathcopies(ui, repo, rev1, rev2, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	824 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	825 timer, fm = gettimer(ui, opts)
18877 2e9fe9e2671f perf: add a command to test copies.pathcopies perf Siddharth Agarwal <sid0@fb.com> parents: 18871 diff changeset	826 ctx1 = scmutil.revsingle(repo, rev1, rev1)
2e9fe9e2671f perf: add a command to test copies.pathcopies perf Siddharth Agarwal <sid0@fb.com> parents: 18871 diff changeset	827 ctx2 = scmutil.revsingle(repo, rev2, rev2)
2e9fe9e2671f perf: add a command to test copies.pathcopies perf Siddharth Agarwal <sid0@fb.com> parents: 18871 diff changeset	828 def d():
2e9fe9e2671f perf: add a command to test copies.pathcopies perf Siddharth Agarwal <sid0@fb.com> parents: 18871 diff changeset	829 copies.pathcopies(ctx1, ctx2)
2e9fe9e2671f perf: add a command to test copies.pathcopies perf Siddharth Agarwal <sid0@fb.com> parents: 18871 diff changeset	830 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	831 fm.end()
18877 2e9fe9e2671f perf: add a command to test copies.pathcopies perf Siddharth Agarwal <sid0@fb.com> parents: 18871 diff changeset	832
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	833 @command(b'perfphases',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	834 [(b'', b'full', False, b'include file reading time too'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	835 ], b"")
32501 ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	836 def perfphases(ui, repo, **opts):
ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	837 """benchmark phasesets computation"""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	838 opts = _byteskwargs(opts)
32501 ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	839 timer, fm = gettimer(ui, opts)
32752 e36569bd9e28 perfphases: add a flag to also include file access time Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32751 diff changeset	840 _phases = repo._phasecache
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	841 full = opts.get(b'full')
32501 ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	842 def d():
32752 e36569bd9e28 perfphases: add a flag to also include file access time Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32751 diff changeset	843 phases = _phases
e36569bd9e28 perfphases: add a flag to also include file access time Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32751 diff changeset	844 if full:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	845 clearfilecache(repo, b'_phasecache')
32752 e36569bd9e28 perfphases: add a flag to also include file access time Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32751 diff changeset	846 phases = repo._phasecache
32501 ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	847 phases.invalidate()
ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	848 phases.loadphaserevs(repo)
ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	849 timer(d)
ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	850 fm.end()
ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	851
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	852 @command(b'perfphasesremote',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	853 [], b"[DEST]")
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	854 def perfphasesremote(ui, repo, dest=None, **opts):
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	855 """benchmark time needed to analyse phases of the remote server"""
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	856 from mercurial.node import (
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	857 bin,
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	858 )
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	859 from mercurial import (
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	860 exchange,
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	861 hg,
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	862 phases,
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	863 )
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	864 opts = _byteskwargs(opts)
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	865 timer, fm = gettimer(ui, opts)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	866
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	867 path = ui.paths.getpath(dest, default=(b'default-push', b'default'))
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	868 if not path:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	869 raise error.Abort((b'default repository not configured!'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	870 hint=(b"see 'hg help config.paths'"))
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	871 dest = path.pushloc or path.loc
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	872 branches = (path.branch, opts.get(b'branch') or [])
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	873 ui.status((b'analysing phase of %s\n') % util.hidepassword(dest))
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	874 revs, checkout = hg.addbranchrevs(repo, repo, branches, opts.get(b'rev'))
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	875 other = hg.peer(repo, opts, dest)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	876
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	877 # easier to perform discovery through the operation
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	878 op = exchange.pushoperation(repo, other)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	879 exchange._pushdiscoverychangeset(op)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	880
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	881 remotesubset = op.fallbackheads
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	882
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	883 with other.commandexecutor() as e:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	884 remotephases = e.callcommand(b'listkeys',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	885 {b'namespace': b'phases'}).result()
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	886 del other
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	887 publishing = remotephases.get(b'publishing', False)
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	888 if publishing:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	889 ui.status((b'publishing: yes\n'))
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	890 else:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	891 ui.status((b'publishing: no\n'))
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	892
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	893 nodemap = repo.changelog.nodemap
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	894 nonpublishroots = 0
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	895 for nhex, phase in remotephases.iteritems():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	896 if nhex == b'publishing': # ignore data related to publish option
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	897 continue
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	898 node = bin(nhex)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	899 if node in nodemap and int(phase):
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	900 nonpublishroots += 1
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	901 ui.status((b'number of roots: %d\n') % len(remotephases))
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	902 ui.status((b'number of known non public roots: %d\n') % nonpublishroots)
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	903 def d():
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	904 phases.remotephasessummary(repo,
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	905 remotesubset,
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	906 remotephases)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	907 timer(d)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	908 fm.end()
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	909
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	910 @command(b'perfmanifest',[
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	911 (b'm', b'manifest-rev', False, b'Look up a manifest node revision'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	912 (b'', b'clear-disk', False, b'clear on-disk caches too'),
40142 25ce80ce84c5 perf: accept formatter option for perfmanifest Boris Feld <boris.feld@octobus.net> parents: 40141 diff changeset	913 ] + formatteropts, b'REV\|NODE')
38820 ddb15a83ae0b debug: allow specifying a manifest node rather than a revision Martijn Pieters <mj@zopatista.com> parents: 38819 diff changeset	914 def perfmanifest(ui, repo, rev, manifest_rev=False, clear_disk=False, **opts):
38693 9b6a708f2263 perf: document the perfmanifest command Boris Feld <boris.feld@octobus.net> parents: 38285 diff changeset	915 """benchmark the time to read a manifest from disk and return a usable
9b6a708f2263 perf: document the perfmanifest command Boris Feld <boris.feld@octobus.net> parents: 38285 diff changeset	916 dict-like object
9b6a708f2263 perf: document the perfmanifest command Boris Feld <boris.feld@octobus.net> parents: 38285 diff changeset	917
9b6a708f2263 perf: document the perfmanifest command Boris Feld <boris.feld@octobus.net> parents: 38285 diff changeset	918 Manifest caches are cleared before retrieval."""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	919 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	920 timer, fm = gettimer(ui, opts)
38820 ddb15a83ae0b debug: allow specifying a manifest node rather than a revision Martijn Pieters <mj@zopatista.com> parents: 38819 diff changeset	921 if not manifest_rev:
ddb15a83ae0b debug: allow specifying a manifest node rather than a revision Martijn Pieters <mj@zopatista.com> parents: 38819 diff changeset	922 ctx = scmutil.revsingle(repo, rev, rev)
ddb15a83ae0b debug: allow specifying a manifest node rather than a revision Martijn Pieters <mj@zopatista.com> parents: 38819 diff changeset	923 t = ctx.manifestnode()
ddb15a83ae0b debug: allow specifying a manifest node rather than a revision Martijn Pieters <mj@zopatista.com> parents: 38819 diff changeset	924 else:
39345 c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	925 from mercurial.node import bin
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	926
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	927 if len(rev) == 40:
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	928 t = bin(rev)
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	929 else:
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	930 try:
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	931 rev = int(rev)
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	932
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	933 if util.safehasattr(repo.manifestlog, b'getstorage'):
39345 c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	934 t = repo.manifestlog.getstorage(b'').node(rev)
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	935 else:
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	936 t = repo.manifestlog._revlog.lookup(rev)
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	937 except ValueError:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	938 raise error.Abort(b'manifest revision must be integer or full '
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	939 b'node')
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	940 def d():
38821 0a57945aaf7f manifest: persist the manifestfulltext cache Martijn Pieters <mj@zopatista.com> parents: 38820 diff changeset	941 repo.manifestlog.clearcaches(clear_persisted_data=clear_disk)
30379 d79c141fdf41 manifest: remove usages of manifest.read Durham Goode <durham@fb.com> parents: 30347 diff changeset	942 repo.manifestlog[t].read()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	943 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	944 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	945
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	946 @command(b'perfchangeset', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	947 def perfchangeset(ui, repo, rev, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	948 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	949 timer, fm = gettimer(ui, opts)
37355 5bcd5859b505 perf: make perfmanifest and perfnodelookup work with revsets Martin von Zweigbergk <martinvonz@google.com> parents: 37271 diff changeset	950 n = scmutil.revsingle(repo, rev).node()
16262 bf7a6c3b2a4a perf: add perfchangeset to time changeset parsing Matt Mackall <mpm@selenic.com> parents: 16260 diff changeset	951 def d():
19378 9de689d20230 cleanup: drop unused variables and an unused import Simon Heimberg <simohe@besonet.ch> parents: 19322 diff changeset	952 repo.changelog.read(n)
16266 77d56a5e74a5 perf: add a changeset test Matt Mackall <mpm@selenic.com> parents: 16262 diff changeset	953 #repo.changelog._cache = None
16262 bf7a6c3b2a4a perf: add perfchangeset to time changeset parsing Matt Mackall <mpm@selenic.com> parents: 16260 diff changeset	954 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	955 fm.end()
16262 bf7a6c3b2a4a perf: add perfchangeset to time changeset parsing Matt Mackall <mpm@selenic.com> parents: 16260 diff changeset	956
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	957 @command(b'perfindex', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	958 def perfindex(ui, repo, **opts):
13255 2696730ca233 perf: make perfindex results useful on hg with lazyparser Matt Mackall <mpm@selenic.com> parents: 13254 diff changeset	959 import mercurial.revlog
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	960 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	961 timer, fm = gettimer(ui, opts)
13277 9f707b297b0f perf: restore lazyindex hack Matt Mackall <mpm@selenic.com> parents: 13262 diff changeset	962 mercurial.revlog._prereadsize = 2**24 # disable lazy parser in old hg
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	963 n = repo[b"tip"].node()
30146 148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	964 svfs = getsvfs(repo)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	965 def d():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	966 cl = mercurial.revlog.revlog(svfs, b"00changelog.i")
16260 33fcad3cfbbc perf: tweak tests for testing index performance improvements Matt Mackall <mpm@selenic.com> parents: 14671 diff changeset	967 cl.rev(n)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	968 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	969 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	970
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	971 @command(b'perfstartup', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	972 def perfstartup(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	973 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	974 timer, fm = gettimer(ui, opts)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	975 def d():
39829 db875f97a969 py3: un-byteify strings around os.system() and os.devnull in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39828 diff changeset	976 if os.name != r'nt':
40349 1524c305377f py3: restore perfstartup() prior to b456b2e0ad9f on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 40295 diff changeset	977 os.system(b"HGRCPATH= %s version -q > /dev/null" %
1524c305377f py3: restore perfstartup() prior to b456b2e0ad9f on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 40295 diff changeset	978 fsencode(sys.argv[0]))
27382 de7bcbc68042 perf: adjust perfstartup() for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 27345 diff changeset	979 else:
39829 db875f97a969 py3: un-byteify strings around os.system() and os.devnull in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39828 diff changeset	980 os.environ[r'HGRCPATH'] = r' '
40349 1524c305377f py3: restore perfstartup() prior to b456b2e0ad9f on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 40295 diff changeset	981 os.system(r"%s version -q > NUL" % sys.argv[0])
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	982 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	983 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	984
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	985 @command(b'perfparents', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	986 def perfparents(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	987 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	988 timer, fm = gettimer(ui, opts)
27305 5831cfbf0e33 perf: perfparents honor config perf.parentscount timeless <timeless@mozdev.org> parents: 27304 diff changeset	989 # control the number of commits perfparents iterates over
5831cfbf0e33 perf: perfparents honor config perf.parentscount timeless <timeless@mozdev.org> parents: 27304 diff changeset	990 # experimental config: perf.parentscount
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	991 count = getint(ui, b"perf", b"parentscount", 1000)
27305 5831cfbf0e33 perf: perfparents honor config perf.parentscount timeless <timeless@mozdev.org> parents: 27304 diff changeset	992 if len(repo.changelog) < count:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	993 raise error.Abort(b"repo needs %d commits for this test" % count)
27100 8d5dba93aa4f contrib/perf: perfparents handle filtered repos timeless <timeless@mozdev.org> parents: 27099 diff changeset	994 repo = repo.unfiltered()
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	995 nl = [repo.changelog.node(i) for i in _xrange(count)]
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	996 def d():
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	997 for n in nl:
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	998 repo.changelog.parents(n)
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	999 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1000 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	1001
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1002 @command(b'perfctxfiles', formatteropts)
27095 aaf4e2d77148 contrib/perf: name functions to match decorators timeless <timeless@mozdev.org> parents: 27072 diff changeset	1003 def perfctxfiles(ui, repo, x, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1004 opts = _byteskwargs(opts)
24349 389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1005 x = int(x)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1006 timer, fm = gettimer(ui, opts)
24349 389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1007 def d():
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1008 len(repo[x].files())
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1009 timer(d)
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1010 fm.end()
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1011
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1012 @command(b'perfrawfiles', formatteropts)
27095 aaf4e2d77148 contrib/perf: name functions to match decorators timeless <timeless@mozdev.org> parents: 27072 diff changeset	1013 def perfrawfiles(ui, repo, x, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1014 opts = _byteskwargs(opts)
24349 389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1015 x = int(x)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1016 timer, fm = gettimer(ui, opts)
24349 389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1017 cl = repo.changelog
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1018 def d():
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1019 len(cl.read(x)[3])
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1020 timer(d)
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1021 fm.end()
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1022
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1023 @command(b'perflookup', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1024 def perflookup(ui, repo, rev, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1025 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1026 timer, fm = gettimer(ui, opts)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	1027 timer(lambda: len(repo.lookup(rev)))
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1028 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	1029
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1030 @command(b'perflinelogedits',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1031 [(b'n', b'edits', 10000, b'number of edits'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1032 (b'', b'max-hunk-lines', 10, b'max lines in a hunk'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1033 ], norepo=True)
39007 1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1034 def perflinelogedits(ui, **opts):
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1035 from mercurial import linelog
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1036
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1037 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1038
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1039 edits = opts[b'edits']
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1040 maxhunklines = opts[b'max_hunk_lines']
39007 1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1041
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1042 maxb1 = 100000
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1043 random.seed(0)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1044 randint = random.randint
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1045 currentlines = 0
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1046 arglist = []
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1047 for rev in _xrange(edits):
39007 1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1048 a1 = randint(0, currentlines)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1049 a2 = randint(a1, min(currentlines, a1 + maxhunklines))
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1050 b1 = randint(0, maxb1)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1051 b2 = randint(b1, b1 + maxhunklines)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1052 currentlines += (b2 - b1) - (a2 - a1)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1053 arglist.append((rev, a1, a2, b1, b2))
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1054
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1055 def d():
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1056 ll = linelog.linelog()
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1057 for args in arglist:
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1058 ll.replacelines(*args)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1059
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1060 timer, fm = gettimer(ui, opts)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1061 timer(d)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1062 fm.end()
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1063
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1064 @command(b'perfrevrange', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1065 def perfrevrange(ui, repo, specs, *opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1066 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1067 timer, fm = gettimer(ui, opts)
16858 fdf99e0f60f3 perf: add a benchmark for revrange Bryan O'Sullivan <bryano@fb.com> parents: 16802 diff changeset	1068 revrange = scmutil.revrange
fdf99e0f60f3 perf: add a benchmark for revrange Bryan O'Sullivan <bryano@fb.com> parents: 16802 diff changeset	1069 timer(lambda: len(revrange(repo, specs)))
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1070 fm.end()
16858 fdf99e0f60f3 perf: add a benchmark for revrange Bryan O'Sullivan <bryano@fb.com> parents: 16802 diff changeset	1071
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1072 @command(b'perfnodelookup', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1073 def perfnodelookup(ui, repo, rev, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1074 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1075 timer, fm = gettimer(ui, opts)
16309 e0c1b3ef7c36 perf: node lookup Matt Mackall <mpm@selenic.com> parents: 16266 diff changeset	1076 import mercurial.revlog
e0c1b3ef7c36 perf: node lookup Matt Mackall <mpm@selenic.com> parents: 16266 diff changeset	1077 mercurial.revlog._prereadsize = 2**24 # disable lazy parser in old hg
37355 5bcd5859b505 perf: make perfmanifest and perfnodelookup work with revsets Martin von Zweigbergk <martinvonz@google.com> parents: 37271 diff changeset	1078 n = scmutil.revsingle(repo, rev).node()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1079 cl = mercurial.revlog.revlog(getsvfs(repo), b"00changelog.i")
16414 e8d37b78acfb parsers: use base-16 trie for faster node->rev mapping Bryan O'Sullivan <bryano@fb.com> parents: 16403 diff changeset	1080 def d():
e8d37b78acfb parsers: use base-16 trie for faster node->rev mapping Bryan O'Sullivan <bryano@fb.com> parents: 16403 diff changeset	1081 cl.rev(n)
16785 1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	1082 clearcaches(cl)
16414 e8d37b78acfb parsers: use base-16 trie for faster node->rev mapping Bryan O'Sullivan <bryano@fb.com> parents: 16403 diff changeset	1083 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1084 fm.end()
16414 e8d37b78acfb parsers: use base-16 trie for faster node->rev mapping Bryan O'Sullivan <bryano@fb.com> parents: 16403 diff changeset	1085
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1086 @command(b'perflog',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1087 [(b'', b'rename', False, b'ask log to follow renames')
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1088 ] + formatteropts)
27306 bafb1235f505 perf: add optional rev for perflog and perftemplating timeless <timeless@mozdev.org> parents: 27305 diff changeset	1089 def perflog(ui, repo, rev=None, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1090 opts = _byteskwargs(opts)
27306 bafb1235f505 perf: add optional rev for perflog and perftemplating timeless <timeless@mozdev.org> parents: 27305 diff changeset	1091 if rev is None:
bafb1235f505 perf: add optional rev for perflog and perftemplating timeless <timeless@mozdev.org> parents: 27305 diff changeset	1092 rev=[]
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1093 timer, fm = gettimer(ui, opts)
7872 f680a1bd679b contrib: add perflog and perftemplating commands to perf extension Alexander Solovyov <piranha@piranha.org.ua> parents: 7366 diff changeset	1094 ui.pushbuffer()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1095 timer(lambda: commands.log(ui, repo, rev=rev, date=b'', user=b'',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1096 copies=opts.get(b'rename')))
7872 f680a1bd679b contrib: add perflog and perftemplating commands to perf extension Alexander Solovyov <piranha@piranha.org.ua> parents: 7366 diff changeset	1097 ui.popbuffer()
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1098 fm.end()
7872 f680a1bd679b contrib: add perflog and perftemplating commands to perf extension Alexander Solovyov <piranha@piranha.org.ua> parents: 7366 diff changeset	1099
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1100 @command(b'perfmoonwalk', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1101 def perfmoonwalk(ui, repo, **opts):
20178 74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1102 """benchmark walking the changelog backwards
74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1103
74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1104 This also loads the changelog data for each revision in the changelog.
74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1105 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1106 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1107 timer, fm = gettimer(ui, opts)
20178 74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1108 def moonwalk():
38819 a4d847cea6f8 perfmoonwalk: make work with filtered repo Martin von Zweigbergk <martinvonz@google.com> parents: 38695 diff changeset	1109 for i in repo.changelog.revs(start=(len(repo) - 1), stop=-1):
20178 74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1110 ctx = repo[i]
74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1111 ctx.branch() # read changelog data (in addition to the index)
74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1112 timer(moonwalk)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1113 fm.end()
20178 74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1114
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1115 @command(b'perftemplating',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1116 [(b'r', b'rev', [], b'revisions to run the template on'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1117 ] + formatteropts)
38270 ae6e02fcee24 perftemplating: allow to specify the template to test Boris Feld <boris.feld@octobus.net> parents: 38269 diff changeset	1118 def perftemplating(ui, repo, testedtemplate=None, **opts):
ae6e02fcee24 perftemplating: allow to specify the template to test Boris Feld <boris.feld@octobus.net> parents: 38269 diff changeset	1119 """test the rendering time of a given template"""
38269 a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1120 if makelogtemplater is None:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1121 raise error.Abort((b"perftemplating not available with this Mercurial"),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1122 hint=b"use 4.3 or later")
38269 a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1123
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1124 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1125
38267 71d59b487d0c perftemplating: drop usage of buffer Boris Feld <boris.feld@octobus.net> parents: 38266 diff changeset	1126 nullui = ui.copy()
39829 db875f97a969 py3: un-byteify strings around os.system() and os.devnull in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39828 diff changeset	1127 nullui.fout = open(os.devnull, r'wb')
38267 71d59b487d0c perftemplating: drop usage of buffer Boris Feld <boris.feld@octobus.net> parents: 38266 diff changeset	1128 nullui.disablepager()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1129 revs = opts.get(b'rev')
38269 a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1130 if not revs:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1131 revs = [b'all()']
38269 a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1132 revs = list(scmutil.revrange(repo, revs))
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1133
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1134 defaulttemplate = (b'{date\|shortdate} [{rev}:{node\|short}]'
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1135 b' {author\|person}: {desc\|firstline}\n')
38270 ae6e02fcee24 perftemplating: allow to specify the template to test Boris Feld <boris.feld@octobus.net> parents: 38269 diff changeset	1136 if testedtemplate is None:
ae6e02fcee24 perftemplating: allow to specify the template to test Boris Feld <boris.feld@octobus.net> parents: 38269 diff changeset	1137 testedtemplate = defaulttemplate
ae6e02fcee24 perftemplating: allow to specify the template to test Boris Feld <boris.feld@octobus.net> parents: 38269 diff changeset	1138 displayer = makelogtemplater(nullui, repo, testedtemplate)
38266 6b91815fcdce perftemplating: move template formating into its own function Boris Feld <boris.feld@octobus.net> parents: 38265 diff changeset	1139 def format():
38269 a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1140 for r in revs:
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1141 ctx = repo[r]
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1142 displayer.show(ctx)
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1143 displayer.flush(ctx)
38266 6b91815fcdce perftemplating: move template formating into its own function Boris Feld <boris.feld@octobus.net> parents: 38265 diff changeset	1144
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1145 timer, fm = gettimer(ui, opts)
38266 6b91815fcdce perftemplating: move template formating into its own function Boris Feld <boris.feld@octobus.net> parents: 38265 diff changeset	1146 timer(format)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1147 fm.end()
7872 f680a1bd679b contrib: add perflog and perftemplating commands to perf extension Alexander Solovyov <piranha@piranha.org.ua> parents: 7366 diff changeset	1148
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1149 @command(b'perfcca', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1150 def perfcca(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1151 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1152 timer, fm = gettimer(ui, opts)
17216 01c1ee4bd1dd perf: fix perfcca to work with new casecollisionauditor interface Joshua Redstone <joshua.redstone@fb.com> parents: 16866 diff changeset	1153 timer(lambda: scmutil.casecollisionauditor(ui, False, repo.dirstate))
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1154 fm.end()
16386 ccc173d0914e perf: add case collision auditor perf Matt Mackall <mpm@selenic.com> parents: 16309 diff changeset	1155
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1156 @command(b'perffncacheload', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1157 def perffncacheload(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1158 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1159 timer, fm = gettimer(ui, opts)
17780 769f66861eb8 perf: simply use repo.store for perffncache* commands Adrian Buehlmann <adrian@cadifra.com> parents: 17553 diff changeset	1160 s = repo.store
16403 efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1161 def d():
efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1162 s.fncache._load()
efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1163 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1164 fm.end()
16403 efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1165
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1166 @command(b'perffncachewrite', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1167 def perffncachewrite(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1168 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1169 timer, fm = gettimer(ui, opts)
17780 769f66861eb8 perf: simply use repo.store for perffncache* commands Adrian Buehlmann <adrian@cadifra.com> parents: 17553 diff changeset	1170 s = repo.store
38695 2cdb82e8fb44 perffncachewrite: load fncache after lock is acquired Boris Feld <boris.feld@octobus.net> parents: 38694 diff changeset	1171 lock = repo.lock()
16403 efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1172 s.fncache._load()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1173 tr = repo.transaction(b'perffncachewrite')
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1174 tr.addbackup(b'fncache')
16403 efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1175 def d():
efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1176 s.fncache._dirty = True
27097 b3e24a9c5f9b contrib/perf: fix perffncachewrite timeless <timeless@mozdev.org> parents: 27096 diff changeset	1177 s.fncache.write(tr)
16403 efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1178 timer(d)
30069 98b9846a131e perf: release lock after transaction in perffncachewrite Pierre-Yves David <pierre-yves.david@ens-lyon.org> parents: 30020 diff changeset	1179 tr.close()
27097 b3e24a9c5f9b contrib/perf: fix perffncachewrite timeless <timeless@mozdev.org> parents: 27096 diff changeset	1180 lock.release()
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1181 fm.end()
16403 efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1182
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1183 @command(b'perffncacheencode', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1184 def perffncacheencode(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1185 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1186 timer, fm = gettimer(ui, opts)
17780 769f66861eb8 perf: simply use repo.store for perffncache* commands Adrian Buehlmann <adrian@cadifra.com> parents: 17553 diff changeset	1187 s = repo.store
17553 5ab863922e0f perf: add perffncacheencode Adrian Buehlmann <adrian@cadifra.com> parents: 17216 diff changeset	1188 s.fncache._load()
5ab863922e0f perf: add perffncacheencode Adrian Buehlmann <adrian@cadifra.com> parents: 17216 diff changeset	1189 def d():
5ab863922e0f perf: add perffncacheencode Adrian Buehlmann <adrian@cadifra.com> parents: 17216 diff changeset	1190 for p in s.fncache.entries:
5ab863922e0f perf: add perffncacheencode Adrian Buehlmann <adrian@cadifra.com> parents: 17216 diff changeset	1191 s.encode(p)
5ab863922e0f perf: add perffncacheencode Adrian Buehlmann <adrian@cadifra.com> parents: 17216 diff changeset	1192 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1193 fm.end()
17553 5ab863922e0f perf: add perffncacheencode Adrian Buehlmann <adrian@cadifra.com> parents: 17216 diff changeset	1194
36774 d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1195 def _bdiffworker(q, blocks, xdiff, ready, done):
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1196 while not done.is_set():
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1197 pair = q.get()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1198 while pair is not None:
36774 d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1199 if xdiff:
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1200 mdiff.bdiff.xdiffblocks(*pair)
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1201 elif blocks:
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1202 mdiff.bdiff.blocks(*pair)
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1203 else:
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1204 mdiff.textdiff(*pair)
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1205 q.task_done()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1206 pair = q.get()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1207 q.task_done() # for the None one
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1208 with ready:
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1209 ready.wait()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1210
39346 862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1211 def _manifestrevision(repo, mnode):
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1212 ml = repo.manifestlog
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1213
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1214 if util.safehasattr(ml, b'getstorage'):
39346 862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1215 store = ml.getstorage(b'')
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1216 else:
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1217 store = ml._revlog
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1218
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1219 return store.revision(mnode)
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1220
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1221 @command(b'perfbdiff', revlogopts + formatteropts + [
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1222 (b'', b'count', 1, b'number of revisions to test (when using --startrev)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1223 (b'', b'alldata', False, b'test bdiffs for all associated revisions'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1224 (b'', b'threads', 0, b'number of thread to use (disable with 0)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1225 (b'', b'blocks', False, b'test computing diffs into blocks'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1226 (b'', b'xdiff', False, b'use xdiff algorithm'),
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1227 ],
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1228
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1229 b'-c\|-m\|FILE REV')
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1230 def perfbdiff(ui, repo, file_, rev=None, count=None, threads=0, **opts):
30346 7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1231 """benchmark a bdiff between revisions
7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1232
7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1233 By default, benchmark a bdiff between its delta parent and itself.
7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1234
7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1235 With ``--count``, benchmark bdiffs between delta parents and self for N
7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1236 revisions starting at the specified revision.
30347 6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1237
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1238 With ``--alldata``, assume the requested revision is a changeset and
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1239 measure bdiffs for all changes related to that changeset (manifest
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1240 and filelogs).
30346 7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1241 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1242 opts = _byteskwargs(opts)
36774 d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1243
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1244 if opts[b'xdiff'] and not opts[b'blocks']:
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1245 raise error.CommandError(b'perfbdiff', b'--xdiff requires --blocks')
36774 d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1246
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1247 if opts[b'alldata']:
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1248 opts[b'changelog'] = True
30347 6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1249
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1250 if opts.get(b'changelog') or opts.get(b'manifest'):
30320 c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1251 file_, rev = None, file_
c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1252 elif rev is None:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1253 raise error.CommandError(b'perfbdiff', b'invalid arguments')
30320 c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1254
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1255 blocks = opts[b'blocks']
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1256 xdiff = opts[b'xdiff']
30345 7d91a085ebe6 perf: prepare to handle multiple pairs in perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30320 diff changeset	1257 textpairs = []
7d91a085ebe6 perf: prepare to handle multiple pairs in perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30320 diff changeset	1258
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1259 r = cmdutil.openrevlog(repo, b'perfbdiff', file_, opts)
30320 c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1260
30346 7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1261 startrev = r.rev(r.lookup(rev))
7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1262 for rev in range(startrev, min(startrev + count, len(r) - 1)):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1263 if opts[b'alldata']:
30347 6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1264 # Load revisions associated with changeset.
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1265 ctx = repo[rev]
39346 862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1266 mtext = _manifestrevision(repo, ctx.manifestnode())
30347 6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1267 for pctx in ctx.parents():
39346 862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1268 pman = _manifestrevision(repo, pctx.manifestnode())
30347 6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1269 textpairs.append((pman, mtext))
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1270
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1271 # Load filelog revisions by iterating manifest delta.
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1272 man = ctx.manifest()
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1273 pman = ctx.p1().manifest()
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1274 for filename, change in pman.diff(man).items():
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1275 fctx = repo.file(filename)
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1276 f1 = fctx.revision(change[0][0] or -1)
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1277 f2 = fctx.revision(change[1][0] or -1)
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1278 textpairs.append((f1, f2))
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1279 else:
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1280 dp = r.deltaparent(rev)
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1281 textpairs.append((r.revision(dp), r.revision(rev)))
30320 c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1282
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1283 withthreads = threads > 0
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1284 if not withthreads:
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1285 def d():
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1286 for pair in textpairs:
36774 d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1287 if xdiff:
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1288 mdiff.bdiff.xdiffblocks(*pair)
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1289 elif blocks:
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1290 mdiff.bdiff.blocks(*pair)
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1291 else:
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1292 mdiff.textdiff(*pair)
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1293 else:
37890 8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	1294 q = queue()
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1295 for i in _xrange(threads):
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1296 q.put(None)
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1297 ready = threading.Condition()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1298 done = threading.Event()
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1299 for i in _xrange(threads):
36774 d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1300 threading.Thread(target=_bdiffworker,
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1301 args=(q, blocks, xdiff, ready, done)).start()
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1302 q.join()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1303 def d():
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1304 for pair in textpairs:
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1305 q.put(pair)
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1306 for i in _xrange(threads):
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1307 q.put(None)
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1308 with ready:
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1309 ready.notify_all()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1310 q.join()
30320 c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1311 timer, fm = gettimer(ui, opts)
c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1312 timer(d)
c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1313 fm.end()
c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1314
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1315 if withthreads:
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1316 done.set()
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1317 for i in _xrange(threads):
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1318 q.put(None)
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1319 with ready:
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1320 ready.notify_all()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1321
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1322 @command(b'perfunidiff', revlogopts + formatteropts + [
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1323 (b'', b'count', 1, b'number of revisions to test (when using --startrev)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1324 (b'', b'alldata', False, b'test unidiffs for all associated revisions'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1325 ], b'-c\|-m\|FILE REV')
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1326 def perfunidiff(ui, repo, file_, rev=None, count=None, **opts):
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1327 """benchmark a unified diff between revisions
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1328
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1329 This doesn't include any copy tracing - it's just a unified diff
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1330 of the texts.
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1331
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1332 By default, benchmark a diff between its delta parent and itself.
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1333
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1334 With ``--count``, benchmark diffs between delta parents and self for N
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1335 revisions starting at the specified revision.
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1336
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1337 With ``--alldata``, assume the requested revision is a changeset and
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1338 measure diffs for all changes related to that changeset (manifest
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1339 and filelogs).
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1340 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1341 opts = _byteskwargs(opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1342 if opts[b'alldata']:
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1343 opts[b'changelog'] = True
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1344
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1345 if opts.get(b'changelog') or opts.get(b'manifest'):
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1346 file_, rev = None, file_
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1347 elif rev is None:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1348 raise error.CommandError(b'perfunidiff', b'invalid arguments')
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1349
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1350 textpairs = []
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1351
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1352 r = cmdutil.openrevlog(repo, b'perfunidiff', file_, opts)
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1353
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1354 startrev = r.rev(r.lookup(rev))
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1355 for rev in range(startrev, min(startrev + count, len(r) - 1)):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1356 if opts[b'alldata']:
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1357 # Load revisions associated with changeset.
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1358 ctx = repo[rev]
39346 862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1359 mtext = _manifestrevision(repo, ctx.manifestnode())
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1360 for pctx in ctx.parents():
39346 862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1361 pman = _manifestrevision(repo, pctx.manifestnode())
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1362 textpairs.append((pman, mtext))
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1363
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1364 # Load filelog revisions by iterating manifest delta.
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1365 man = ctx.manifest()
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1366 pman = ctx.p1().manifest()
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1367 for filename, change in pman.diff(man).items():
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1368 fctx = repo.file(filename)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1369 f1 = fctx.revision(change[0][0] or -1)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1370 f2 = fctx.revision(change[1][0] or -1)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1371 textpairs.append((f1, f2))
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1372 else:
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1373 dp = r.deltaparent(rev)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1374 textpairs.append((r.revision(dp), r.revision(rev)))
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1375
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1376 def d():
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1377 for left, right in textpairs:
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1378 # The date strings don't matter, so we pass empty strings.
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1379 headerlines, hunks = mdiff.unidiff(
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1380 left, b'', right, b'', b'left', b'right', binary=False)
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1381 # consume iterators in roughly the way patch.py does
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1382 b'\n'.join(headerlines)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1383 b''.join(sum((list(hlines) for hrange, hlines in hunks), []))
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1384 timer, fm = gettimer(ui, opts)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1385 timer(d)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1386 fm.end()
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1387
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1388 @command(b'perfdiffwd', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1389 def perfdiffwd(ui, repo, **opts):
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1390 """Profile diff of working directory changes"""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1391 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1392 timer, fm = gettimer(ui, opts)
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1393 options = {
40214 b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	1394 'w': 'ignore_all_space',
b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	1395 'b': 'ignore_space_change',
b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	1396 'B': 'ignore_blank_lines',
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1397 }
d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1398
40214 b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	1399 for diffopt in ('', 'w', 'b', 'B', 'wB'):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1400 opts = dict((options[c], b'1') for c in diffopt)
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1401 def d():
d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1402 ui.pushbuffer()
d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1403 commands.diff(ui, repo, **opts)
d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1404 ui.popbuffer()
40214 b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	1405 diffopt = diffopt.encode('ascii')
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1406 title = b'diffopts: %s' % (diffopt and (b'-' + diffopt) or b'none')
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1407 timer(d, title)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1408 fm.end()
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1409
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1410 @command(b'perfrevlogindex', revlogopts + formatteropts,
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1411 b'-c\|-m\|FILE')
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1412 def perfrevlogindex(ui, repo, file_=None, **opts):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1413 """Benchmark operations against a revlog index.
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1414
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1415 This tests constructing a revlog instance, reading index data,
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1416 parsing index data, and performing various operations related to
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1417 index data.
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1418 """
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1419
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1420 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1421
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1422 rl = cmdutil.openrevlog(repo, b'perfrevlogindex', file_, opts)
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1423
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1424 opener = getattr(rl, 'opener') # trick linter
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1425 indexfile = rl.indexfile
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1426 data = opener.read(indexfile)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1427
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1428 header = struct.unpack(b'>I', data[0:4])[0]
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1429 version = header & 0xFFFF
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1430 if version == 1:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1431 revlogio = revlog.revlogio()
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1432 inline = header & (1 << 16)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1433 else:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1434 raise error.Abort((b'unsupported revlog version: %d') % version)
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1435
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1436 rllen = len(rl)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1437
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1438 node0 = rl.node(0)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1439 node25 = rl.node(rllen // 4)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1440 node50 = rl.node(rllen // 2)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1441 node75 = rl.node(rllen // 4 * 3)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1442 node100 = rl.node(rllen - 1)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1443
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1444 allrevs = range(rllen)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1445 allrevsrev = list(reversed(allrevs))
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1446 allnodes = [rl.node(rev) for rev in range(rllen)]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1447 allnodesrev = list(reversed(allnodes))
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1448
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1449 def constructor():
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1450 revlog.revlog(opener, indexfile)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1451
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1452 def read():
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1453 with opener(indexfile) as fh:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1454 fh.read()
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1455
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1456 def parseindex():
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1457 revlogio.parseindex(data, inline)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1458
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1459 def getentry(revornode):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1460 index = revlogio.parseindex(data, inline)[0]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1461 index[revornode]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1462
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1463 def getentries(revs, count=1):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1464 index = revlogio.parseindex(data, inline)[0]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1465
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1466 for i in range(count):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1467 for rev in revs:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1468 index[rev]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1469
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1470 def resolvenode(node):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1471 nodemap = revlogio.parseindex(data, inline)[1]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1472 # This only works for the C code.
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1473 if nodemap is None:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1474 return
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1475
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1476 try:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1477 nodemap[node]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1478 except error.RevlogError:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1479 pass
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1480
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1481 def resolvenodes(nodes, count=1):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1482 nodemap = revlogio.parseindex(data, inline)[1]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1483 if nodemap is None:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1484 return
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1485
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1486 for i in range(count):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1487 for node in nodes:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1488 try:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1489 nodemap[node]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1490 except error.RevlogError:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1491 pass
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1492
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1493 benches = [
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1494 (constructor, b'revlog constructor'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1495 (read, b'read'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1496 (parseindex, b'create index object'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1497 (lambda: getentry(0), b'retrieve index entry for rev 0'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1498 (lambda: resolvenode(b'a' * 20), b'look up missing node'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1499 (lambda: resolvenode(node0), b'look up node at rev 0'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1500 (lambda: resolvenode(node25), b'look up node at 1/4 len'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1501 (lambda: resolvenode(node50), b'look up node at 1/2 len'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1502 (lambda: resolvenode(node75), b'look up node at 3/4 len'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1503 (lambda: resolvenode(node100), b'look up node at tip'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1504 # 2x variation is to measure caching impact.
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1505 (lambda: resolvenodes(allnodes),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1506 b'look up all nodes (forward)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1507 (lambda: resolvenodes(allnodes, 2),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1508 b'look up all nodes 2x (forward)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1509 (lambda: resolvenodes(allnodesrev),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1510 b'look up all nodes (reverse)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1511 (lambda: resolvenodes(allnodesrev, 2),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1512 b'look up all nodes 2x (reverse)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1513 (lambda: getentries(allrevs),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1514 b'retrieve all index entries (forward)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1515 (lambda: getentries(allrevs, 2),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1516 b'retrieve all index entries 2x (forward)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1517 (lambda: getentries(allrevsrev),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1518 b'retrieve all index entries (reverse)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1519 (lambda: getentries(allrevsrev, 2),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1520 b'retrieve all index entries 2x (reverse)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1521 ]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1522
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1523 for fn, title in benches:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1524 timer, fm = gettimer(ui, opts)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1525 timer(fn, title=title)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1526 fm.end()
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1527
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1528 @command(b'perfrevlogrevisions', revlogopts + formatteropts +
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1529 [(b'd', b'dist', 100, b'distance between the revisions'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1530 (b's', b'startrev', 0, b'revision to start reading at'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1531 (b'', b'reverse', False, b'read in reverse')],
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1532 b'-c\|-m\|FILE')
32564 7236facefd4f perf: rename perfrevlog to perfrevlogrevisions Gregory Szorc <gregory.szorc@gmail.com> parents: 32501 diff changeset	1533 def perfrevlogrevisions(ui, repo, file_=None, startrev=0, reverse=False,
7236facefd4f perf: rename perfrevlog to perfrevlogrevisions Gregory Szorc <gregory.szorc@gmail.com> parents: 32501 diff changeset	1534 **opts):
27492 ac549d7fbc2b perf: use standard arguments for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27472 diff changeset	1535 """Benchmark reading a series of revisions from a revlog.
ac549d7fbc2b perf: use standard arguments for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27472 diff changeset	1536
ac549d7fbc2b perf: use standard arguments for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27472 diff changeset	1537 By default, we read every ``-d/--dist`` revision from 0 to tip of
ac549d7fbc2b perf: use standard arguments for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27472 diff changeset	1538 the specified revlog.
27493 14b0930105da perf: make start revision configurable for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27492 diff changeset	1539
14b0930105da perf: make start revision configurable for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27492 diff changeset	1540 The start revision can be defined via ``-s/--startrev``.
27492 ac549d7fbc2b perf: use standard arguments for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27472 diff changeset	1541 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1542 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1543
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1544 rl = cmdutil.openrevlog(repo, b'perfrevlogrevisions', file_, opts)
32272 4c6b2076d292 perf: move revlog construction and length calculation out of benchmark Gregory Szorc <gregory.szorc@gmail.com> parents: 32271 diff changeset	1545 rllen = getlen(ui)(rl)
30019 973cf6c3de30 perf: add --reverse to perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 29567 diff changeset	1546
40143 d5d28d360a19 pref: support negative indexing in perfrevlogrevisions Boris Feld <boris.feld@octobus.net> parents: 40142 diff changeset	1547 if startrev < 0:
d5d28d360a19 pref: support negative indexing in perfrevlogrevisions Boris Feld <boris.feld@octobus.net> parents: 40142 diff changeset	1548 startrev = rllen + startrev
d5d28d360a19 pref: support negative indexing in perfrevlogrevisions Boris Feld <boris.feld@octobus.net> parents: 40142 diff changeset	1549
11694 bf49d48e4602 perf: add perfrevlog function to check performance of revlog Pradeepkumar Gayam <in3xes@gmail.com> parents: 10493 diff changeset	1550 def d():
32272 4c6b2076d292 perf: move revlog construction and length calculation out of benchmark Gregory Szorc <gregory.szorc@gmail.com> parents: 32271 diff changeset	1551 rl.clearcaches()
30019 973cf6c3de30 perf: add --reverse to perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 29567 diff changeset	1552
32264 6b582f9b6e5e perf: don't clobber startrev variable Gregory Szorc <gregory.szorc@gmail.com> parents: 32246 diff changeset	1553 beginrev = startrev
32272 4c6b2076d292 perf: move revlog construction and length calculation out of benchmark Gregory Szorc <gregory.szorc@gmail.com> parents: 32271 diff changeset	1554 endrev = rllen
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1555 dist = opts[b'dist']
30019 973cf6c3de30 perf: add --reverse to perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 29567 diff changeset	1556
973cf6c3de30 perf: add --reverse to perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 29567 diff changeset	1557 if reverse:
40587 cbd251d479bb perf: fix perfrevlogrevisions --reverse Boris Feld <boris.feld@octobus.net> parents: 40581 diff changeset	1558 beginrev, endrev = endrev - 1, beginrev - 1
30019 973cf6c3de30 perf: add --reverse to perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 29567 diff changeset	1559 dist = -1 * dist
973cf6c3de30 perf: add --reverse to perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 29567 diff changeset	1560
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1561 for x in _xrange(beginrev, endrev, dist):
32337 d7efaf6275a7 perf: always pass node to revlog.revision() Gregory Szorc <gregory.szorc@gmail.com> parents: 32272 diff changeset	1562 # Old revisions don't support passing int.
d7efaf6275a7 perf: always pass node to revlog.revision() Gregory Szorc <gregory.szorc@gmail.com> parents: 32272 diff changeset	1563 n = rl.node(x)
d7efaf6275a7 perf: always pass node to revlog.revision() Gregory Szorc <gregory.szorc@gmail.com> parents: 32272 diff changeset	1564 rl.revision(n)
11694 bf49d48e4602 perf: add perfrevlog function to check performance of revlog Pradeepkumar Gayam <in3xes@gmail.com> parents: 10493 diff changeset	1565
32265 c68c400d0a2d perf: move gettimer() call Gregory Szorc <gregory.szorc@gmail.com> parents: 32264 diff changeset	1566 timer, fm = gettimer(ui, opts)
11694 bf49d48e4602 perf: add perfrevlog function to check performance of revlog Pradeepkumar Gayam <in3xes@gmail.com> parents: 10493 diff changeset	1567 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1568 fm.end()
11694 bf49d48e4602 perf: add perfrevlog function to check performance of revlog Pradeepkumar Gayam <in3xes@gmail.com> parents: 10493 diff changeset	1569
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1570 @command(b'perfrevlogwrite', revlogopts + formatteropts +
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1571 [(b's', b'startrev', 1000, b'revision to start writing at'),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1572 (b'', b'stoprev', -1, b'last revision to write'),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1573 (b'', b'count', 3, b'last revision to write'),
40598 4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1574 (b'', b'details', False, b'print timing for every revisions tested'),
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1575 (b'', b'source', b'full', b'the kind of data feed in the revlog'),
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1576 ],
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1577 b'-c\|-m\|FILE')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1578 def perfrevlogwrite(ui, repo, file_=None, startrev=1000, stoprev=-1, **opts):
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1579 """Benchmark writing a series of revisions to a revlog.
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1580
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1581 Possible source values are:
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1582 * `full`: add from a full text (default).
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1583 """
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1584 opts = _byteskwargs(opts)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1585
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1586 rl = cmdutil.openrevlog(repo, b'perfrevlogwrite', file_, opts)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1587 rllen = getlen(ui)(rl)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1588 if startrev < 0:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1589 startrev = rllen + startrev
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1590 if stoprev < 0:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1591 stoprev = rllen + stoprev
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1592
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1593 source = opts['source']
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1594 validsource = (b'full',)
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1595 if source not in validsource:
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1596 raise error.Abort('invalid source type: %s' % source)
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1597
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1598 ### actually gather results
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1599 count = opts['count']
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1600 if count <= 0:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1601 raise error.Abort('invalide run count: %d' % count)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1602 allresults = []
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1603 for c in range(count):
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1604 timing = _timeonewrite(ui, rl, source, startrev, stoprev, c + 1)
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1605 allresults.append(timing)
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1606
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1607 ### consolidate the results in a single list
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1608 results = []
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1609 for idx, (rev, t) in enumerate(allresults[0]):
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1610 ts = [t]
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1611 for other in allresults[1:]:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1612 orev, ot = other[idx]
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1613 assert orev == rev
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1614 ts.append(ot)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1615 results.append((rev, ts))
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1616 resultcount = len(results)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1617
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1618 ### Compute and display relevant statistics
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1619
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1620 # get a formatter
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1621 fm = ui.formatter(b'perf', opts)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1622 displayall = ui.configbool(b"perf", b"all-timing", False)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1623
40598 4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1624 # print individual details if requested
4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1625 if opts['details']:
4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1626 for idx, item in enumerate(results, 1):
4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1627 rev, data = item
4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1628 title = 'revisions #%d of %d, rev %d' % (idx, resultcount, rev)
4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1629 formatone(fm, data, title=title, displayall=displayall)
4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1630
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1631 # sorts results by median time
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1632 results.sort(key=lambda x: sorted(x[1])[len(x[1]) // 2])
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1633 # list of (name, index) to display)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1634 relevants = [
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1635 ("min", 0),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1636 ("10%", resultcount * 10 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1637 ("25%", resultcount * 25 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1638 ("50%", resultcount * 70 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1639 ("75%", resultcount * 75 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1640 ("90%", resultcount * 90 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1641 ("95%", resultcount * 95 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1642 ("99%", resultcount * 99 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1643 ("max", -1),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1644 ]
40599 c63081cd3902 perf: only display the total time for perfrevlogwrite if quiet Boris Feld <boris.feld@octobus.net> parents: 40598 diff changeset	1645 if not ui.quiet:
c63081cd3902 perf: only display the total time for perfrevlogwrite if quiet Boris Feld <boris.feld@octobus.net> parents: 40598 diff changeset	1646 for name, idx in relevants:
c63081cd3902 perf: only display the total time for perfrevlogwrite if quiet Boris Feld <boris.feld@octobus.net> parents: 40598 diff changeset	1647 data = results[idx]
c63081cd3902 perf: only display the total time for perfrevlogwrite if quiet Boris Feld <boris.feld@octobus.net> parents: 40598 diff changeset	1648 title = '%s of %d, rev %d' % (name, resultcount, data[0])
c63081cd3902 perf: only display the total time for perfrevlogwrite if quiet Boris Feld <boris.feld@octobus.net> parents: 40598 diff changeset	1649 formatone(fm, data[1], title=title, displayall=displayall)
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1650
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1651 # XXX summing that many float will not be very precise, we ignore this fact
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1652 # for now
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1653 totaltime = []
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1654 for item in allresults:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1655 totaltime.append((sum(x[1][0] for x in item),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1656 sum(x[1][1] for x in item),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1657 sum(x[1][2] for x in item),)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1658 )
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1659 formatone(fm, totaltime, title="total time (%d revs)" % resultcount,
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1660 displayall=displayall)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1661 fm.end()
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1662
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1663 class _faketr(object):
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1664 def add(s, x, y, z=None):
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1665 return None
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1666
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1667 def _timeonewrite(ui, orig, source, startrev, stoprev, runidx=None):
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1668 timings = []
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1669 tr = _faketr()
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1670 with _temprevlog(ui, orig, startrev) as dest:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1671 revs = list(orig.revs(startrev, stoprev))
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1672 total = len(revs)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1673 topic = 'adding'
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1674 if runidx is not None:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1675 topic += ' (run #%d)' % runidx
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1676 for idx, rev in enumerate(revs):
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1677 ui.progress(topic, idx, unit='revs', total=total)
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1678 addargs, addkwargs = _getrevisionseed(orig, rev, tr, source)
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1679 with timeone() as r:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1680 dest.addrawrevision(addargs, *addkwargs)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1681 timings.append((rev, r[0]))
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1682 ui.progress(topic, total, unit='revs', total=total)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1683 ui.progress(topic, None, unit='revs', total=total)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1684 return timings
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1685
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1686 def _getrevisionseed(orig, rev, tr, source):
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1687 linkrev = orig.linkrev(rev)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1688 node = orig.node(rev)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1689 p1, p2 = orig.parents(node)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1690 flags = orig.flags(rev)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1691 cachedelta = None
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1692 text = None
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1693
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1694 if source == b'full':
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1695 text = orig.revision(rev)
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1696
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1697 return ((text, tr, linkrev, p1, p2),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1698 {'node': node, 'flags': flags, 'cachedelta': cachedelta})
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1699
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1700 @contextlib.contextmanager
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1701 def _temprevlog(ui, orig, truncaterev):
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1702 from mercurial import vfs as vfsmod
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1703
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1704 if orig._inline:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1705 raise error.Abort('not supporting inline revlog (yet)')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1706
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1707 origindexpath = orig.opener.join(orig.indexfile)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1708 origdatapath = orig.opener.join(orig.datafile)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1709 indexname = 'revlog.i'
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1710 dataname = 'revlog.d'
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1711
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1712 tmpdir = tempfile.mkdtemp(prefix='tmp-hgperf-')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1713 try:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1714 # copy the data file in a temporary directory
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1715 ui.debug('copying data in %s\n' % tmpdir)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1716 destindexpath = os.path.join(tmpdir, 'revlog.i')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1717 destdatapath = os.path.join(tmpdir, 'revlog.d')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1718 shutil.copyfile(origindexpath, destindexpath)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1719 shutil.copyfile(origdatapath, destdatapath)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1720
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1721 # remove the data we want to add again
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1722 ui.debug('truncating data to be rewritten\n')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1723 with open(destindexpath, 'ab') as index:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1724 index.seek(0)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1725 index.truncate(truncaterev * orig._io.size)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1726 with open(destdatapath, 'ab') as data:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1727 data.seek(0)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1728 data.truncate(orig.start(truncaterev))
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1729
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1730 # instantiate a new revlog from the temporary copy
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1731 ui.debug('truncating adding to be rewritten\n')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1732 vfs = vfsmod.vfs(tmpdir)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1733 vfs.options = getattr(orig.opener, 'options', None)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1734
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1735 dest = revlog.revlog(vfs,
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1736 indexfile=indexname,
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1737 datafile=dataname)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1738 if dest._inline:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1739 raise error.Abort('not supporting inline revlog (yet)')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1740 # make sure internals are initialized
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1741 dest.revision(len(dest) - 1)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1742 yield dest
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1743 del dest, vfs
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1744 finally:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1745 shutil.rmtree(tmpdir, True)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1746
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1747 @command(b'perfrevlogchunks', revlogopts + formatteropts +
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1748 [(b'e', b'engines', b'', b'compression engines to use'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1749 (b's', b'startrev', 0, b'revision to start at')],
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1750 b'-c\|-m\|FILE')
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1751 def perfrevlogchunks(ui, repo, file_=None, engines=None, startrev=0, **opts):
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1752 """Benchmark operations on revlog chunks.
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1753
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1754 Logically, each revlog is a collection of fulltext revisions. However,
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1755 stored within each revlog are "chunks" of possibly compressed data. This
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1756 data needs to be read and decompressed or compressed and written.
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1757
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1758 This command measures the time it takes to read+decompress and recompress
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1759 chunks in a revlog. It effectively isolates I/O and compression performance.
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1760 For measurements of higher-level operations like resolving revisions,
32564 7236facefd4f perf: rename perfrevlog to perfrevlogrevisions Gregory Szorc <gregory.szorc@gmail.com> parents: 32501 diff changeset	1761 see ``perfrevlogrevisions`` and ``perfrevlogrevision``.
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1762 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1763 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1764
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1765 rl = cmdutil.openrevlog(repo, b'perfrevlogchunks', file_, opts)
32269 75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1766
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1767 # _chunkraw was renamed to _getsegmentforrevs.
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1768 try:
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1769 segmentforrevs = rl._getsegmentforrevs
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1770 except AttributeError:
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1771 segmentforrevs = rl._chunkraw
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1772
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1773 # Verify engines argument.
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1774 if engines:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1775 engines = set(e.strip() for e in engines.split(b','))
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1776 for engine in engines:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1777 try:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1778 util.compressionengines[engine]
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1779 except KeyError:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1780 raise error.Abort(b'unknown compression engine: %s' % engine)
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1781 else:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1782 engines = []
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1783 for e in util.compengines:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1784 engine = util.compengines[e]
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1785 try:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1786 if engine.available():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1787 engine.revlogcompressor().compress(b'dummy')
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1788 engines.append(e)
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1789 except NotImplementedError:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1790 pass
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1791
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1792 revs = list(rl.revs(startrev, len(rl) - 1))
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1793
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1794 def rlfh(rl):
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1795 if rl._inline:
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1796 return getsvfs(repo)(rl.indexfile)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1797 else:
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1798 return getsvfs(repo)(rl.datafile)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1799
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1800 def doread():
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1801 rl.clearcaches()
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1802 for rev in revs:
32268 112ba1c7d65d perf: store reference to revlog._chunkraw in a local variable Gregory Szorc <gregory.szorc@gmail.com> parents: 32265 diff changeset	1803 segmentforrevs(rev, rev)
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1804
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1805 def doreadcachedfh():
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1806 rl.clearcaches()
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1807 fh = rlfh(rl)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1808 for rev in revs:
32268 112ba1c7d65d perf: store reference to revlog._chunkraw in a local variable Gregory Szorc <gregory.szorc@gmail.com> parents: 32265 diff changeset	1809 segmentforrevs(rev, rev, df=fh)
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1810
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1811 def doreadbatch():
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1812 rl.clearcaches()
32268 112ba1c7d65d perf: store reference to revlog._chunkraw in a local variable Gregory Szorc <gregory.szorc@gmail.com> parents: 32265 diff changeset	1813 segmentforrevs(revs[0], revs[-1])
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1814
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1815 def doreadbatchcachedfh():
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1816 rl.clearcaches()
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1817 fh = rlfh(rl)
32268 112ba1c7d65d perf: store reference to revlog._chunkraw in a local variable Gregory Szorc <gregory.szorc@gmail.com> parents: 32265 diff changeset	1818 segmentforrevs(revs[0], revs[-1], df=fh)
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1819
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1820 def dochunk():
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1821 rl.clearcaches()
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1822 fh = rlfh(rl)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1823 for rev in revs:
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1824 rl._chunk(rev, df=fh)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1825
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1826 chunks = [None]
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1827
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1828 def dochunkbatch():
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1829 rl.clearcaches()
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1830 fh = rlfh(rl)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1831 # Save chunks as a side-effect.
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1832 chunks[0] = rl._chunks(revs, df=fh)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1833
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1834 def docompress(compressor):
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1835 rl.clearcaches()
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1836
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1837 try:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1838 # Swap in the requested compression engine.
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1839 oldcompressor = rl._compressor
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1840 rl._compressor = compressor
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1841 for chunk in chunks[0]:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1842 rl.compress(chunk)
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1843 finally:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1844 rl._compressor = oldcompressor
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1845
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1846 benches = [
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1847 (lambda: doread(), b'read'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1848 (lambda: doreadcachedfh(), b'read w/ reused fd'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1849 (lambda: doreadbatch(), b'read batch'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1850 (lambda: doreadbatchcachedfh(), b'read batch w/ reused fd'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1851 (lambda: dochunk(), b'chunk'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1852 (lambda: dochunkbatch(), b'chunk batch'),
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1853 ]
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1854
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1855 for engine in sorted(engines):
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1856 compressor = util.compengines[engine].revlogcompressor()
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1857 benches.append((functools.partial(docompress, compressor),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1858 b'compress w/ %s' % engine))
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1859
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1860 for fn, title in benches:
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1861 timer, fm = gettimer(ui, opts)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1862 timer(fn, title=title)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1863 fm.end()
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1864
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1865 @command(b'perfrevlogrevision', revlogopts + formatteropts +
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1866 [(b'', b'cache', False, b'use caches instead of clearing')],
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1867 b'-c\|-m\|FILE REV')
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1868 def perfrevlogrevision(ui, repo, file_, rev=None, cache=None, **opts):
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1869 """Benchmark obtaining a revlog revision.
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1870
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1871 Obtaining a revlog revision consists of roughly the following steps:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1872
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1873 1. Compute the delta chain
40581 e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1874 2. Slice the delta chain if applicable
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1875 3. Obtain the raw chunks for that delta chain
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1876 4. Decompress each raw chunk
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1877 5. Apply binary patches to obtain fulltext
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1878 6. Verify hash of fulltext
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1879
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1880 This command measures the time spent in each of these phases.
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1881 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1882 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1883
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1884 if opts.get(b'changelog') or opts.get(b'manifest'):
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1885 file_, rev = None, file_
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1886 elif rev is None:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1887 raise error.CommandError(b'perfrevlogrevision', b'invalid arguments')
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1888
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1889 r = cmdutil.openrevlog(repo, b'perfrevlogrevision', file_, opts)
32269 75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1890
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1891 # _chunkraw was renamed to _getsegmentforrevs.
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1892 try:
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1893 segmentforrevs = r._getsegmentforrevs
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1894 except AttributeError:
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1895 segmentforrevs = r._chunkraw
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1896
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1897 node = r.lookup(rev)
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1898 rev = r.rev(node)
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1899
30914 74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1900 def getrawchunks(data, chain):
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1901 start = r.start
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1902 length = r.length
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1903 inline = r._inline
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1904 iosize = r._io.size
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1905 buffer = util.buffer
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1906
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1907 chunks = []
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1908 ladd = chunks.append
40580 914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1909 for idx, item in enumerate(chain):
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1910 offset = start(item[0])
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1911 bits = data[idx]
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1912 for rev in item:
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1913 chunkstart = start(rev)
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1914 if inline:
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1915 chunkstart += (rev + 1) * iosize
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1916 chunklength = length(rev)
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1917 ladd(buffer(bits, chunkstart - offset, chunklength))
30914 74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1918
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1919 return chunks
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1920
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1921 def dodeltachain(rev):
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1922 if not cache:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1923 r.clearcaches()
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1924 r._deltachain(rev)
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1925
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1926 def doread(chain):
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1927 if not cache:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1928 r.clearcaches()
40580 914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1929 for item in slicedchain:
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1930 segmentforrevs(item[0], item[-1])
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1931
40581 e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1932 def doslice(r, chain, size):
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1933 for s in slicechunk(r, chain, targetsize=size):
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1934 pass
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1935
30914 74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1936 def dorawchunks(data, chain):
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1937 if not cache:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1938 r.clearcaches()
30914 74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1939 getrawchunks(data, chain)
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1940
30914 74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1941 def dodecompress(chunks):
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1942 decomp = r.decompress
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1943 for chunk in chunks:
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	1944 decomp(chunk)
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1945
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1946 def dopatch(text, bins):
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1947 if not cache:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1948 r.clearcaches()
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1949 mdiff.patches(text, bins)
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1950
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1951 def dohash(text):
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1952 if not cache:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1953 r.clearcaches()
30589 be5b2098a817 revlog: merge hash checking subfunctions Remi Chaintron <remi@fb.com> parents: 30460 diff changeset	1954 r.checkhash(text, node, rev=rev)
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1955
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1956 def dorevision():
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1957 if not cache:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1958 r.clearcaches()
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1959 r.revision(node)
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1960
40580 914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1961 try:
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1962 from mercurial.revlogutils.deltas import slicechunk
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1963 except ImportError:
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1964 slicechunk = getattr(revlog, '_slicechunk', None)
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1965
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1966 size = r.length(rev)
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1967 chain = r._deltachain(rev)[0]
40580 914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1968 if not getattr(r, '_withsparseread', False):
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1969 slicedchain = (chain,)
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1970 else:
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1971 slicedchain = tuple(slicechunk(r, chain, targetsize=size))
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1972 data = [segmentforrevs(seg[0], seg[-1])[1] for seg in slicedchain]
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1973 rawchunks = getrawchunks(data, slicedchain)
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1974 bins = r._chunks(chain)
40214 b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	1975 text = bytes(bins[0])
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1976 bins = bins[1:]
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1977 text = mdiff.patches(text, bins)
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1978
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1979 benches = [
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1980 (lambda: dorevision(), b'full'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1981 (lambda: dodeltachain(rev), b'deltachain'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1982 (lambda: doread(chain), b'read'),
40581 e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1983 ]
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1984
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1985 if getattr(r, '_withsparseread', False):
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1986 slicing = (lambda: doslice(r, chain, size), b'slice-sparse-chain')
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1987 benches.append(slicing)
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1988
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1989 benches.extend([
40580 914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	1990 (lambda: dorawchunks(data, slicedchain), b'rawchunks'),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1991 (lambda: dodecompress(rawchunks), b'decompress'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1992 (lambda: dopatch(text, bins), b'patch'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1993 (lambda: dohash(text), b'hash'),
40581 e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	1994 ])
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1995
40579 cf3bef7f162b perf: use the same timer for all section of perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40349 diff changeset	1996 timer, fm = gettimer(ui, opts)
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1997 for fn, title in benches:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1998 timer(fn, title=title)
40579 cf3bef7f162b perf: use the same timer for all section of perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40349 diff changeset	1999 fm.end()
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2000
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2001 @command(b'perfrevset',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2002 [(b'C', b'clear', False, b'clear volatile cache between each call.'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2003 (b'', b'contexts', False, b'obtain changectx for each revision')]
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2004 + formatteropts, b"REVSET")
27072 e18a9ceade3b perf: support obtaining contexts from perfrevset Gregory Szorc <gregory.szorc@gmail.com> parents: 27017 diff changeset	2005 def perfrevset(ui, repo, expr, clear=False, contexts=False, **opts):
18239 a95f1d619bb7 perftest: add an option to invalidate volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18238 diff changeset	2006 """benchmark the execution time of a revset
a95f1d619bb7 perftest: add an option to invalidate volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18238 diff changeset	2007
18644 3e92772d5383 spelling: fix some minor issues found by spell checker Mads Kiilerich <mads@kiilerich.com> parents: 18304 diff changeset	2008 Use the --clean option if need to evaluate the impact of build volatile
18239 a95f1d619bb7 perftest: add an option to invalidate volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18238 diff changeset	2009 revisions set cache on the revset execution. Volatile cache hold filtered
a95f1d619bb7 perftest: add an option to invalidate volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18238 diff changeset	2010 and obsolete related cache."""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2011 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2012
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	2013 timer, fm = gettimer(ui, opts)
18062 1471f5e83686 perf: add a command to measure revset performance Siddharth Agarwal <sid0@fb.com> parents: 18033 diff changeset	2014 def d():
18239 a95f1d619bb7 perftest: add an option to invalidate volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18238 diff changeset	2015 if clear:
a95f1d619bb7 perftest: add an option to invalidate volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18238 diff changeset	2016 repo.invalidatevolatilesets()
27072 e18a9ceade3b perf: support obtaining contexts from perfrevset Gregory Szorc <gregory.szorc@gmail.com> parents: 27017 diff changeset	2017 if contexts:
e18a9ceade3b perf: support obtaining contexts from perfrevset Gregory Szorc <gregory.szorc@gmail.com> parents: 27017 diff changeset	2018 for ctx in repo.set(expr): pass
e18a9ceade3b perf: support obtaining contexts from perfrevset Gregory Szorc <gregory.szorc@gmail.com> parents: 27017 diff changeset	2019 else:
e18a9ceade3b perf: support obtaining contexts from perfrevset Gregory Szorc <gregory.szorc@gmail.com> parents: 27017 diff changeset	2020 for r in repo.revs(expr): pass
18062 1471f5e83686 perf: add a command to measure revset performance Siddharth Agarwal <sid0@fb.com> parents: 18033 diff changeset	2021 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	2022 fm.end()
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2023
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2024 @command(b'perfvolatilesets',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2025 [(b'', b'clear-obsstore', False, b'drop obsstore between each call.'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2026 ] + formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	2027 def perfvolatilesets(ui, repo, names, *opts):
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2028 """benchmark the computation of various volatile set
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2029
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2030 Volatile set computes element related to filtering and obsolescence."""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2031 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	2032 timer, fm = gettimer(ui, opts)
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2033 repo = repo.unfiltered()
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2034
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2035 def getobs(name):
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2036 def d():
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2037 repo.invalidatevolatilesets()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2038 if opts[b'clear_obsstore']:
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2039 clearfilecache(repo, b'obsstore')
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2040 obsolete.getrevs(repo, name)
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2041 return d
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2042
18241 f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2043 allobs = sorted(obsolete.cachefuncs)
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2044 if names:
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2045 allobs = [n for n in allobs if n in names]
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2046
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2047 for name in allobs:
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2048 timer(getobs(name), title=name)
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2049
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2050 def getfiltered(name):
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2051 def d():
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2052 repo.invalidatevolatilesets()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2053 if opts[b'clear_obsstore']:
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2054 clearfilecache(repo, b'obsstore')
20205 d67a7758da6d perf: fix perfvolatilesets Pierre-Yves David <pierre-yves.david@ens-lyon.org> parents: 20178 diff changeset	2055 repoview.filterrevs(repo, name)
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2056 return d
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2057
18241 f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2058 allfilter = sorted(repoview.filtertable)
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2059 if names:
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2060 allfilter = [n for n in allfilter if n in names]
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2061
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2062 for name in allfilter:
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2063 timer(getfiltered(name), title=name)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	2064 fm.end()
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2065
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2066 @command(b'perfbranchmap',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2067 [(b'f', b'full', False,
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2068 b'Includes build time of subset'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2069 (b'', b'clear-revbranch', False,
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2070 b'purge the revbranch cache between computation'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2071 ] + formatteropts)
36393 c25290b98190 perfbranchmap: allow to select the filter to benchmark Boris Feld <boris.feld@octobus.net> parents: 36392 diff changeset	2072 def perfbranchmap(ui, repo, filternames, *opts):
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2073 """benchmark the update of a branchmap
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2074
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2075 This benchmarks the full repo.branchmap() call with read and write disabled
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2076 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2077 opts = _byteskwargs(opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2078 full = opts.get(b"full", False)
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2079 clear_revbranch = opts.get(b"clear_revbranch", False)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	2080 timer, fm = gettimer(ui, opts)
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2081 def getbranchmap(filtername):
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2082 """generate a benchmark function for the filtername"""
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2083 if filtername is None:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2084 view = repo
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2085 else:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2086 view = repo.filtered(filtername)
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2087 def d():
32730 326c0e2c1a1d perfbranchmap: add an option to purge the revbranch cache Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32565 diff changeset	2088 if clear_revbranch:
326c0e2c1a1d perfbranchmap: add an option to purge the revbranch cache Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32565 diff changeset	2089 repo.revbranchcache()._clear()
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2090 if full:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2091 view._branchcaches.clear()
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2092 else:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2093 view._branchcaches.pop(filtername, None)
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2094 view.branchmap()
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2095 return d
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2096 # add filter in smaller subset to bigger subset
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2097 possiblefilters = set(repoview.filtertable)
36393 c25290b98190 perfbranchmap: allow to select the filter to benchmark Boris Feld <boris.feld@octobus.net> parents: 36392 diff changeset	2098 if filternames:
c25290b98190 perfbranchmap: allow to select the filter to benchmark Boris Feld <boris.feld@octobus.net> parents: 36392 diff changeset	2099 possiblefilters &= set(filternames)
30144 14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	2100 subsettable = getbranchmapsubsettable()
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2101 allfilters = []
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2102 while possiblefilters:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2103 for name in possiblefilters:
30144 14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	2104 subset = subsettable.get(name)
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2105 if subset not in possiblefilters:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2106 break
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2107 else:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2108 assert False, b'subset cycle %s!' % possiblefilters
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2109 allfilters.append(name)
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2110 possiblefilters.remove(name)
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2111
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2112 # warm the cache
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2113 if not full:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2114 for name in allfilters:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2115 repo.filtered(name).branchmap()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2116 if not filternames or b'unfiltered' in filternames:
36393 c25290b98190 perfbranchmap: allow to select the filter to benchmark Boris Feld <boris.feld@octobus.net> parents: 36392 diff changeset	2117 # add unfiltered
c25290b98190 perfbranchmap: allow to select the filter to benchmark Boris Feld <boris.feld@octobus.net> parents: 36392 diff changeset	2118 allfilters.append(None)
30145 113aa6145020 perf: avoid actual writing branch cache out correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30144 diff changeset	2119
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2120 branchcacheread = safeattrsetter(branchmap, b'read')
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2121 branchcachewrite = safeattrsetter(branchmap.branchcache, b'write')
30145 113aa6145020 perf: avoid actual writing branch cache out correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30144 diff changeset	2122 branchcacheread.set(lambda repo: None)
113aa6145020 perf: avoid actual writing branch cache out correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30144 diff changeset	2123 branchcachewrite.set(lambda bc, repo: None)
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2124 try:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2125 for name in allfilters:
36392 df3f7f00a3fc perfbranchmap: display 'unfiltered' for unfiltered performance Boris Feld <boris.feld@octobus.net> parents: 36216 diff changeset	2126 printname = name
df3f7f00a3fc perfbranchmap: display 'unfiltered' for unfiltered performance Boris Feld <boris.feld@octobus.net> parents: 36216 diff changeset	2127 if name is None:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2128 printname = b'unfiltered'
36392 df3f7f00a3fc perfbranchmap: display 'unfiltered' for unfiltered performance Boris Feld <boris.feld@octobus.net> parents: 36216 diff changeset	2129 timer(getbranchmap(name), title=str(printname))
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2130 finally:
30145 113aa6145020 perf: avoid actual writing branch cache out correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30144 diff changeset	2131 branchcacheread.restore()
113aa6145020 perf: avoid actual writing branch cache out correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30144 diff changeset	2132 branchcachewrite.restore()
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	2133 fm.end()
23485 ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2134
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2135 @command(b'perfbranchmapload', [
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2136 (b'f', b'filter', b'', b'Specify repoview filter'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2137 (b'', b'list', False, b'List brachmap filter caches'),
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2138 ] + formatteropts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2139 def perfbranchmapread(ui, repo, filter=b'', list=False, **opts):
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2140 """benchmark reading the branchmap"""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2141 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2142
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2143 if list:
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2144 for name, kind, st in repo.cachevfs.readdir(stat=True):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2145 if name.startswith(b'branch2'):
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2146 filtername = name.partition(b'-')[2] or b'unfiltered'
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2147 ui.status(b'%s - %s\n'
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2148 % (filtername, util.bytecount(st.st_size)))
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2149 return
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2150 if filter:
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2151 repo = repoview.repoview(repo, filter)
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2152 else:
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2153 repo = repo.unfiltered()
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2154 # try once without timer, the filter may not be cached
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2155 if branchmap.read(repo) is None:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2156 raise error.Abort(b'No brachmap cached for %s repo'
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2157 % (filter or b'unfiltered'))
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2158 timer, fm = gettimer(ui, opts)
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2159 timer(lambda: branchmap.read(repo) and None)
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2160 fm.end()
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2161
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2162 @command(b'perfloadmarkers')
23485 ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2163 def perfloadmarkers(ui, repo):
ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2164 """benchmark the time to parse the on-disk markers for a repo
ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2165
ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2166 Result is the number of markers in the repo."""
ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2167 timer, fm = gettimer(ui)
30146 148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	2168 svfs = getsvfs(repo)
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	2169 timer(lambda: len(obsolete.obsstore(svfs)))
23485 ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2170 fm.end()
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2171
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2172 @command(b'perflrucachedict', formatteropts +
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2173 [(b'', b'costlimit', 0, b'maximum total cost of items in cache'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2174 (b'', b'mincost', 0, b'smallest cost of items in cache'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2175 (b'', b'maxcost', 100, b'maximum cost of items in cache'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2176 (b'', b'size', 4, b'size of cache'),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2177 (b'', b'gets', 10000, b'number of key lookups'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2178 (b'', b'sets', 10000, b'number of key sets'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2179 (b'', b'mixed', 10000, b'number of mixed mode operations'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2180 (b'', b'mixedgetfreq', 50, b'frequency of get vs set ops in mixed mode')],
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2181 norepo=True)
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2182 def perflrucache(ui, mincost=0, maxcost=100, costlimit=0, size=4,
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2183 gets=10000, sets=10000, mixed=10000, mixedgetfreq=50, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2184 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2185
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2186 def doinit():
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	2187 for i in _xrange(10000):
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2188 util.lrucachedict(size)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2189
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2190 costrange = list(range(mincost, maxcost + 1))
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2191
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2192 values = []
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	2193 for i in _xrange(size):
39828 c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	2194 values.append(random.randint(0, _maxint))
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2195
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2196 # Get mode fills the cache and tests raw lookup performance with no
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2197 # eviction.
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2198 getseq = []
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	2199 for i in _xrange(gets):
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2200 getseq.append(random.choice(values))
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2201
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2202 def dogets():
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2203 d = util.lrucachedict(size)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2204 for v in values:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2205 d[v] = v
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2206 for key in getseq:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2207 value = d[key]
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2208 value # silence pyflakes warning
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2209
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2210 def dogetscost():
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2211 d = util.lrucachedict(size, maxcost=costlimit)
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2212 for i, v in enumerate(values):
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2213 d.insert(v, v, cost=costs[i])
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2214 for key in getseq:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2215 try:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2216 value = d[key]
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2217 value # silence pyflakes warning
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2218 except KeyError:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2219 pass
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2220
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2221 # Set mode tests insertion speed with cache eviction.
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2222 setseq = []
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2223 costs = []
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	2224 for i in _xrange(sets):
39828 c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	2225 setseq.append(random.randint(0, _maxint))
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2226 costs.append(random.choice(costrange))
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2227
39583 ee087f0d7db5 util: allow lrucachedict to track cost of entries Gregory Szorc <gregory.szorc@gmail.com> parents: 39389 diff changeset	2228 def doinserts():
ee087f0d7db5 util: allow lrucachedict to track cost of entries Gregory Szorc <gregory.szorc@gmail.com> parents: 39389 diff changeset	2229 d = util.lrucachedict(size)
ee087f0d7db5 util: allow lrucachedict to track cost of entries Gregory Szorc <gregory.szorc@gmail.com> parents: 39389 diff changeset	2230 for v in setseq:
ee087f0d7db5 util: allow lrucachedict to track cost of entries Gregory Szorc <gregory.szorc@gmail.com> parents: 39389 diff changeset	2231 d.insert(v, v)
ee087f0d7db5 util: allow lrucachedict to track cost of entries Gregory Szorc <gregory.szorc@gmail.com> parents: 39389 diff changeset	2232
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2233 def doinsertscost():
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2234 d = util.lrucachedict(size, maxcost=costlimit)
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2235 for i, v in enumerate(setseq):
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2236 d.insert(v, v, cost=costs[i])
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2237
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2238 def dosets():
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2239 d = util.lrucachedict(size)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2240 for v in setseq:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2241 d[v] = v
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2242
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2243 # Mixed mode randomly performs gets and sets with eviction.
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2244 mixedops = []
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	2245 for i in _xrange(mixed):
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2246 r = random.randint(0, 100)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2247 if r < mixedgetfreq:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2248 op = 0
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2249 else:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2250 op = 1
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2251
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2252 mixedops.append((op,
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2253 random.randint(0, size * 2),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2254 random.choice(costrange)))
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2255
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2256 def domixed():
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2257 d = util.lrucachedict(size)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2258
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2259 for op, v, cost in mixedops:
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2260 if op == 0:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2261 try:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2262 d[v]
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2263 except KeyError:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2264 pass
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2265 else:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2266 d[v] = v
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2267
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2268 def domixedcost():
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2269 d = util.lrucachedict(size, maxcost=costlimit)
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2270
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2271 for op, v, cost in mixedops:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2272 if op == 0:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2273 try:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2274 d[v]
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2275 except KeyError:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2276 pass
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2277 else:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2278 d.insert(v, v, cost=cost)
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2279
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2280 benches = [
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2281 (doinit, b'init'),
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2282 ]
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2283
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2284 if costlimit:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2285 benches.extend([
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2286 (dogetscost, b'gets w/ cost limit'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2287 (doinsertscost, b'inserts w/ cost limit'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2288 (domixedcost, b'mixed w/ cost limit'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2289 ])
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2290 else:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2291 benches.extend([
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2292 (dogets, b'gets'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2293 (doinserts, b'inserts'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2294 (dosets, b'sets'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2295 (domixed, b'mixed')
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2296 ])
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2297
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2298 for fn, title in benches:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2299 timer, fm = gettimer(ui, opts)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2300 timer(fn, title=title)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2301 fm.end()
29495 f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2302
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2303 @command(b'perfwrite', formatteropts)
30997 5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2304 def perfwrite(ui, repo, **opts):
5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2305 """microbenchmark ui.write
5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2306 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2307 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2308
30997 5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2309 timer, fm = gettimer(ui, opts)
5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2310 def write():
5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2311 for i in range(100000):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2312 ui.write((b'Testing write performance\n'))
30997 5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2313 timer(write)
5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2314 fm.end()
5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2315
29495 f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2316 def uisetup(ui):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2317 if (util.safehasattr(cmdutil, b'openrevlog') and
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2318 not util.safehasattr(commands, b'debugrevlogopts')):
29495 f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2319 # for "historical portability":
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2320 # In this case, Mercurial should be 1.9 (or a79fea6b3e77) -
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2321 # 3.7 (or 5606f7d0d063). Therefore, '--dir' option for
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2322 # openrevlog() should cause failure, because it has been
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2323 # available since 3.5 (or 49c583ca48c4).
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2324 def openrevlog(orig, repo, cmd, file_, opts):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2325 if opts.get(b'dir') and not util.safehasattr(repo, b'dirlog'):
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2326 raise error.Abort(b"This version doesn't support --dir option",
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2327 hint=b"use 3.5 or later")
29495 f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2328 return orig(repo, cmd, file_, opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2329 extensions.wrapfunction(cmdutil, b'openrevlog', openrevlog)

Mercurial > public > mercurial-scm > hg-stable

annotate contrib/perf.py @ 40600:631011ff6771