mercurial-scm/hg-stable: contrib/perf.py annotate

annotate contrib/perf.py @ 40778:594e84a2e574

perf: add a `clear-revlogs` flag to `perftags` This flag (on by default) makes it possible to disable the refresh of the changelog and revlog. This is useful to check for the time spent in the core tags logic without the associated side effects. Usually, these side effects are shared with other logics (eg: bookmarks). Example output in my Mercurial repository $ hg perftags ! wall 0.017919 comb 0.020000 user 0.020000 sys 0.000000 (best of 141) $ hg perftags --no-clear-revlogs ! wall 0.012982 comb 0.010000 user 0.010000 sys 0.000000 (best of 207)

author	Boris Feld <boris.feld@octobus.net>
date	Tue, 20 Nov 2018 10:46:20 +0000
parents	415735bfcf2b
children	82c189c511bd

rev	line source
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	1 # perf.py - performance test routines
8873 e872ef2e6758 help: add/fix docstrings for a bunch of extensions Dirkjan Ochtman <dirkjan@ochtman.nl> parents: 8656 diff changeset	2 '''helper extension to measure performance'''
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	3
29493 4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	4 # "historical portability" policy of perf.py:
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	5 #
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	6 # We have to do:
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	7 # - make perf.py "loadable" with as wide Mercurial version as possible
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	8 # This doesn't mean that perf commands work correctly with that Mercurial.
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	9 # BTW, perf.py itself has been available since 1.1 (or eb240755386d).
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	10 # - make historical perf command work correctly with as wide Mercurial
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	11 # version as possible
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	12 #
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	13 # We have to do, if possible with reasonable cost:
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	14 # - make recent perf command for historical feature work correctly
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	15 # with early Mercurial
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	16 #
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	17 # We don't have to do:
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	18 # - make perf command for recent feature work correctly with early
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	19 # Mercurial
4533f5b47949 perf: add historical portability policy for future reference FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 28561 diff changeset	20
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	21 from __future__ import absolute_import
40144 acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	22 import contextlib
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	23 import functools
31406 8f5ed8fa39f8 perf: perform a garbage collection before each iteration Gregory Szorc <gregory.szorc@gmail.com> parents: 30997 diff changeset	24 import gc
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	25 import os
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	26 import random
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	27 import shutil
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	28 import struct
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	29 import sys
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	30 import tempfile
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	31 import threading
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	32 import time
330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	33 from mercurial import (
30020 bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	34 changegroup,
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	35 cmdutil,
330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	36 commands,
330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	37 copies,
330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	38 error,
29495 f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	39 extensions,
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	40 mdiff,
330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	41 merge,
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	42 revlog,
28561 330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	43 util,
330584235c22 contrib: make perf.py use absolute_import Pulkit Goyal <7895pulkit@gmail.com> parents: 27649 diff changeset	44 )
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	45
29494 3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	46 # for "historical portability":
29567 7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	47 # try to import modules separately (in dict order), and ignore
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	48 # failure, because these aren't available with early Mercurial
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	49 try:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	50 from mercurial import branchmap # since 2.5 (or bcee63733aad)
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	51 except ImportError:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	52 pass
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	53 try:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	54 from mercurial import obsolete # since 2.3 (or ad0d6c2b3279)
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	55 except ImportError:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	56 pass
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	57 try:
32376 46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	58 from mercurial import registrar # since 3.7 (or 37d50250b696)
46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	59 dir(registrar) # forcibly load it
46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	60 except ImportError:
46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	61 registrar = None
46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	62 try:
29567 7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	63 from mercurial import repoview # since 2.5 (or 3a6ddacb7198)
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	64 except ImportError:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	65 pass
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	66 try:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	67 from mercurial import scmutil # since 1.9 (or 8b252e826c68)
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	68 except ImportError:
7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	69 pass
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	70
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	71 def identity(a):
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	72 return a
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	73
36216 646002338365 py3: introduce and use pycompat.getargspec Augie Fackler <augie@google.com> parents: 35990 diff changeset	74 try:
646002338365 py3: introduce and use pycompat.getargspec Augie Fackler <augie@google.com> parents: 35990 diff changeset	75 from mercurial import pycompat
646002338365 py3: introduce and use pycompat.getargspec Augie Fackler <augie@google.com> parents: 35990 diff changeset	76 getargspec = pycompat.getargspec # added to module after 4.5
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	77 _byteskwargs = pycompat.byteskwargs # since 4.1 (or fbc3f73dc802)
39826 6787dc1b93a9 py3: handle sysstr conversion around get/set attr in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39779 diff changeset	78 _sysstr = pycompat.sysstr # since 4.0 (or 2219f4f82ede)
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	79 _xrange = pycompat.xrange # since 4.8 (or 7eba8f83129b)
40214 b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	80 fsencode = pycompat.fsencode # since 3.9 (or f4a5e0e86a7e)
39828 c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	81 if pycompat.ispy3:
c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	82 _maxint = sys.maxsize # per py3 docs for replacing maxint
c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	83 else:
c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	84 _maxint = sys.maxint
36216 646002338365 py3: introduce and use pycompat.getargspec Augie Fackler <augie@google.com> parents: 35990 diff changeset	85 except (ImportError, AttributeError):
646002338365 py3: introduce and use pycompat.getargspec Augie Fackler <augie@google.com> parents: 35990 diff changeset	86 import inspect
646002338365 py3: introduce and use pycompat.getargspec Augie Fackler <augie@google.com> parents: 35990 diff changeset	87 getargspec = inspect.getargspec
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	88 _byteskwargs = identity
40214 b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	89 fsencode = identity # no py3 support
39828 c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	90 _maxint = sys.maxint # no py3 support
39826 6787dc1b93a9 py3: handle sysstr conversion around get/set attr in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39779 diff changeset	91 _sysstr = lambda x: x # no py3 support
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	92 _xrange = xrange
29567 7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	93
37890 8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	94 try:
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	95 # 4.7+
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	96 queue = pycompat.queue.Queue
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	97 except (AttributeError, ImportError):
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	98 # <4.7.
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	99 try:
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	100 queue = pycompat.queue
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	101 except (AttributeError, ImportError):
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	102 queue = util.queue
8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	103
38269 a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	104 try:
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	105 from mercurial import logcmdutil
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	106 makelogtemplater = logcmdutil.maketemplater
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	107 except (AttributeError, ImportError):
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	108 try:
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	109 makelogtemplater = cmdutil.makelogtemplater
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	110 except (AttributeError, ImportError):
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	111 makelogtemplater = None
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	112
29567 7e2b389418da perf: import newer modules separately for earlier Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29497 diff changeset	113 # for "historical portability":
29494 3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	114 # define util.safehasattr forcibly, because util.safehasattr has been
3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	115 # available since 1.9.3 (or 94b200a11cf7)
3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	116 _undefined = object()
3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	117 def safehasattr(thing, attr):
39826 6787dc1b93a9 py3: handle sysstr conversion around get/set attr in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39779 diff changeset	118 return getattr(thing, _sysstr(attr), _undefined) is not _undefined
29494 3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	119 setattr(util, 'safehasattr', safehasattr)
3b5389ef5cfe perf: define util.safehasattr forcibly for Mercurial earlier than 1.9.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29493 diff changeset	120
29496 7299370cf304 perf: avoid using formatteropts for Mercurial earlier than 3.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29495 diff changeset	121 # for "historical portability":
31823 f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	122 # define util.timer forcibly, because util.timer has been available
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	123 # since ae5d60bb70c9
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	124 if safehasattr(time, 'perf_counter'):
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	125 util.timer = time.perf_counter
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	126 elif os.name == b'nt':
31823 f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	127 util.timer = time.clock
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	128 else:
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	129 util.timer = time.time
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	130
f6d77af84ef3 perf: add historical portability for util.timer Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 31483 diff changeset	131 # for "historical portability":
29496 7299370cf304 perf: avoid using formatteropts for Mercurial earlier than 3.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29495 diff changeset	132 # use locally defined empty option list, if formatteropts isn't
7299370cf304 perf: avoid using formatteropts for Mercurial earlier than 3.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29495 diff changeset	133 # available, because commands.formatteropts has been available since
7299370cf304 perf: avoid using formatteropts for Mercurial earlier than 3.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29495 diff changeset	134 # 3.2 (or 7a7eed5176a4), even though formatting itself has been
7299370cf304 perf: avoid using formatteropts for Mercurial earlier than 3.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29495 diff changeset	135 # available since 2.2 (or ae5f92e154d3)
32414 04baab18d60a commands: move templates of common command options to cmdutil (API) Yuya Nishihara <yuya@tcha.org> parents: 32376 diff changeset	136 formatteropts = getattr(cmdutil, "formatteropts",
04baab18d60a commands: move templates of common command options to cmdutil (API) Yuya Nishihara <yuya@tcha.org> parents: 32376 diff changeset	137 getattr(commands, "formatteropts", []))
29495 f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	138
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	139 # for "historical portability":
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	140 # use locally defined option list, if debugrevlogopts isn't available,
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	141 # because commands.debugrevlogopts has been available since 3.7 (or
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	142 # 5606f7d0d063), even though cmdutil.openrevlog() has been available
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	143 # since 1.9 (or a79fea6b3e77).
32414 04baab18d60a commands: move templates of common command options to cmdutil (API) Yuya Nishihara <yuya@tcha.org> parents: 32376 diff changeset	144 revlogopts = getattr(cmdutil, "debugrevlogopts",
04baab18d60a commands: move templates of common command options to cmdutil (API) Yuya Nishihara <yuya@tcha.org> parents: 32376 diff changeset	145 getattr(commands, "debugrevlogopts", [
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	146 (b'c', b'changelog', False, (b'open changelog')),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	147 (b'm', b'manifest', False, (b'open manifest')),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	148 (b'', b'dir', False, (b'open directory manifest')),
32414 04baab18d60a commands: move templates of common command options to cmdutil (API) Yuya Nishihara <yuya@tcha.org> parents: 32376 diff changeset	149 ]))
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	150
18237 4132dc9bd5c4 perftest: migrate to new style command declaration Pierre-Yves David <pierre-yves.david@ens-lyon.org> parents: 18236 diff changeset	151 cmdtable = {}
29497 ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	152
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	153 # for "historical portability":
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	154 # define parsealiases locally, because cmdutil.parsealiases has been
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	155 # available since 1.5 (or 6252852b4332)
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	156 def parsealiases(cmd):
40295 fa88170c10bb help: adding a proper declaration for shortlist/basic commands (API) Rodrigo Damazio <rdamazio@google.com> parents: 40214 diff changeset	157 return cmd.split(b"\|")
29497 ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	158
32376 46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	159 if safehasattr(registrar, 'command'):
46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	160 command = registrar.command(cmdtable)
46ba2cdda476 registrar: move cmdutil.command to registrar module (API) Yuya Nishihara <yuya@tcha.org> parents: 32337 diff changeset	161 elif safehasattr(cmdutil, 'command'):
29497 ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	162 command = cmdutil.command(cmdtable)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	163 if b'norepo' not in getargspec(command).args:
29497 ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	164 # for "historical portability":
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	165 # wrap original cmdutil.command, because "norepo" option has
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	166 # been available since 3.1 (or 75a96326cecb)
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	167 _command = command
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	168 def command(name, options=(), synopsis=None, norepo=False):
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	169 if norepo:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	170 commands.norepo += b' %s' % b' '.join(parsealiases(name))
29497 ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	171 return _command(name, list(options), synopsis)
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	172 else:
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	173 # for "historical portability":
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	174 # define "@command" annotation locally, because cmdutil.command
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	175 # has been available since 1.9 (or 2daa5179e73f)
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	176 def command(name, options=(), synopsis=None, norepo=False):
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	177 def decorator(func):
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	178 if synopsis:
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	179 cmdtable[name] = func, list(options), synopsis
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	180 else:
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	181 cmdtable[name] = func, list(options)
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	182 if norepo:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	183 commands.norepo += b' %s' % b' '.join(parsealiases(name))
29497 ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	184 return func
ee2027195847 perf: define command annotation locally for Mercurial earlier than 3.1 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29496 diff changeset	185 return decorator
18237 4132dc9bd5c4 perftest: migrate to new style command declaration Pierre-Yves David <pierre-yves.david@ens-lyon.org> parents: 18236 diff changeset	186
34494 bbb5687e5140 configitems: register the 'perf.stub' config Boris Feld <boris.feld@octobus.net> parents: 34350 diff changeset	187 try:
34749 acdc574cb8d7 contrib-perf: update the config registration Boris Feld <boris.feld@octobus.net> parents: 34678 diff changeset	188 import mercurial.registrar
acdc574cb8d7 contrib-perf: update the config registration Boris Feld <boris.feld@octobus.net> parents: 34678 diff changeset	189 import mercurial.configitems
34494 bbb5687e5140 configitems: register the 'perf.stub' config Boris Feld <boris.feld@octobus.net> parents: 34350 diff changeset	190 configtable = {}
34749 acdc574cb8d7 contrib-perf: update the config registration Boris Feld <boris.feld@octobus.net> parents: 34678 diff changeset	191 configitem = mercurial.registrar.configitem(configtable)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	192 configitem(b'perf', b'presleep',
34749 acdc574cb8d7 contrib-perf: update the config registration Boris Feld <boris.feld@octobus.net> parents: 34678 diff changeset	193 default=mercurial.configitems.dynamicdefault,
acdc574cb8d7 contrib-perf: update the config registration Boris Feld <boris.feld@octobus.net> parents: 34678 diff changeset	194 )
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	195 configitem(b'perf', b'stub',
34749 acdc574cb8d7 contrib-perf: update the config registration Boris Feld <boris.feld@octobus.net> parents: 34678 diff changeset	196 default=mercurial.configitems.dynamicdefault,
34494 bbb5687e5140 configitems: register the 'perf.stub' config Boris Feld <boris.feld@octobus.net> parents: 34350 diff changeset	197 )
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	198 configitem(b'perf', b'parentscount',
34750 caf6c446cbe3 contrib-perf: register the 'parentscount' config item Boris Feld <boris.feld@octobus.net> parents: 34749 diff changeset	199 default=mercurial.configitems.dynamicdefault,
caf6c446cbe3 contrib-perf: register the 'parentscount' config item Boris Feld <boris.feld@octobus.net> parents: 34749 diff changeset	200 )
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	201 configitem(b'perf', b'all-timing',
38694 55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	202 default=mercurial.configitems.dynamicdefault,
55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	203 )
34494 bbb5687e5140 configitems: register the 'perf.stub' config Boris Feld <boris.feld@octobus.net> parents: 34350 diff changeset	204 except (ImportError, AttributeError):
bbb5687e5140 configitems: register the 'perf.stub' config Boris Feld <boris.feld@octobus.net> parents: 34350 diff changeset	205 pass
bbb5687e5140 configitems: register the 'perf.stub' config Boris Feld <boris.feld@octobus.net> parents: 34350 diff changeset	206
27307 f36dc0062b1a perf: add getlen timeless <timeless@mozdev.org> parents: 27306 diff changeset	207 def getlen(ui):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	208 if ui.configbool(b"perf", b"stub", False):
27307 f36dc0062b1a perf: add getlen timeless <timeless@mozdev.org> parents: 27306 diff changeset	209 return lambda x: 1
f36dc0062b1a perf: add getlen timeless <timeless@mozdev.org> parents: 27306 diff changeset	210 return len
f36dc0062b1a perf: add getlen timeless <timeless@mozdev.org> parents: 27306 diff changeset	211
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	212 def gettimer(ui, opts=None):
8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	213 """return a timer function and formatter: (timer, formatter)
8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	214
27303 57bd9c5431a5 perf: improve grammar of gettimer comment timeless <timeless@mozdev.org> parents: 27286 diff changeset	215 This function exists to gather the creation of formatter in a single
57bd9c5431a5 perf: improve grammar of gettimer comment timeless <timeless@mozdev.org> parents: 27286 diff changeset	216 place instead of duplicating it in all performance commands."""
23788 316ad725a1dd perf: add a configurable sleep on startup Matt Mackall <mpm@selenic.com> parents: 23537 diff changeset	217
316ad725a1dd perf: add a configurable sleep on startup Matt Mackall <mpm@selenic.com> parents: 23537 diff changeset	218 # enforce an idle period before execution to counteract power management
25850 b130764e3eb5 perf: mark experimental option presleep Matt Mackall <mpm@selenic.com> parents: 25494 diff changeset	219 # experimental config: perf.presleep
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	220 time.sleep(getint(ui, b"perf", b"presleep", 1))
23788 316ad725a1dd perf: add a configurable sleep on startup Matt Mackall <mpm@selenic.com> parents: 23537 diff changeset	221
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	222 if opts is None:
8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	223 opts = {}
30415 e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	224 # redirect all to stderr unless buffer api is in use
e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	225 if not ui._buffers:
e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	226 ui = ui.copy()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	227 uifout = safeattrsetter(ui, b'fout', ignoremissing=True)
30415 e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	228 if uifout:
e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	229 # for "historical portability":
e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	230 # ui.fout/ferr have been available since 1.9 (or 4e1ccd4c2b6d)
e77e8876886f perf: omit copying ui and redirect to ferr if buffer API is in use Philippe Pepiot <philippe.pepiot@logilab.fr> parents: 30380 diff changeset	231 uifout.set(ui.ferr)
30147 423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	232
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	233 # get a formatter
30147 423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	234 uiformatter = getattr(ui, 'formatter', None)
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	235 if uiformatter:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	236 fm = uiformatter(b'perf', opts)
30147 423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	237 else:
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	238 # for "historical portability":
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	239 # define formatter locally, because ui.formatter has been
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	240 # available since 2.2 (or ae5f92e154d3)
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	241 from mercurial import node
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	242 class defaultformatter(object):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	243 """Minimized composition of baseformatter and plainformatter
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	244 """
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	245 def __init__(self, ui, topic, opts):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	246 self._ui = ui
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	247 if ui.debugflag:
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	248 self.hexfunc = node.hex
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	249 else:
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	250 self.hexfunc = node.short
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	251 def __nonzero__(self):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	252 return False
31483 413b44003462 py3: add __bool__ to every class defining __nonzero__ Gregory Szorc <gregory.szorc@gmail.com> parents: 31406 diff changeset	253 __bool__ = __nonzero__
30147 423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	254 def startitem(self):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	255 pass
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	256 def data(self, **data):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	257 pass
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	258 def write(self, fields, deftext, fielddata, *opts):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	259 self._ui.write(deftext % fielddata, **opts)
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	260 def condwrite(self, cond, fields, deftext, fielddata, *opts):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	261 if cond:
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	262 self._ui.write(deftext % fielddata, **opts)
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	263 def plain(self, text, **opts):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	264 self._ui.write(text, **opts)
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	265 def end(self):
423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	266 pass
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	267 fm = defaultformatter(ui, b'perf', opts)
30147 423bf74d2e5b perf: define formatter locally for Mercurial earlier than 2.2 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30146 diff changeset	268
27304 a6fd79495770 perf: offer perf.stub to only run one loop timeless <timeless@mozdev.org> parents: 27303 diff changeset	269 # stub function, runs code only once instead of in a loop
a6fd79495770 perf: offer perf.stub to only run one loop timeless <timeless@mozdev.org> parents: 27303 diff changeset	270 # experimental config: perf.stub
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	271 if ui.configbool(b"perf", b"stub", False):
27304 a6fd79495770 perf: offer perf.stub to only run one loop timeless <timeless@mozdev.org> parents: 27303 diff changeset	272 return functools.partial(stub_timer, fm), fm
38694 55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	273
55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	274 # experimental config: perf.all-timing
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	275 displayall = ui.configbool(b"perf", b"all-timing", False)
38694 55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	276 return functools.partial(_timer, fm, displayall=displayall), fm
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	277
40719 9d88ae5c635b perf: add a `setup` argument to run code outside of the timed section Boris Feld <boris.feld@octobus.net> parents: 40718 diff changeset	278 def stub_timer(fm, func, setup=None, title=None):
40760 0adc2c0a0792 perf: run 'setup' function during stub run Boris Feld <boris.feld@octobus.net> parents: 40759 diff changeset	279 if setup is not None:
0adc2c0a0792 perf: run 'setup' function during stub run Boris Feld <boris.feld@octobus.net> parents: 40759 diff changeset	280 setup()
27304 a6fd79495770 perf: offer perf.stub to only run one loop timeless <timeless@mozdev.org> parents: 27303 diff changeset	281 func()
a6fd79495770 perf: offer perf.stub to only run one loop timeless <timeless@mozdev.org> parents: 27303 diff changeset	282
40144 acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	283 @contextlib.contextmanager
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	284 def timeone():
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	285 r = []
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	286 ostart = os.times()
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	287 cstart = util.timer()
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	288 yield r
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	289 cstop = util.timer()
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	290 ostop = os.times()
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	291 a, b = ostart, ostop
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	292 r.append((cstop - cstart, b[0] - a[0], b[1]-a[1]))
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	293
40719 9d88ae5c635b perf: add a `setup` argument to run code outside of the timed section Boris Feld <boris.feld@octobus.net> parents: 40718 diff changeset	294 def _timer(fm, func, setup=None, title=None, displayall=False):
31406 8f5ed8fa39f8 perf: perform a garbage collection before each iteration Gregory Szorc <gregory.szorc@gmail.com> parents: 30997 diff changeset	295 gc.collect()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	296 results = []
30995 22fbca1d11ed mercurial: switch to util.timer for all interval timings Simon Farnsworth <simonfar@fb.com> parents: 30914 diff changeset	297 begin = util.timer()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	298 count = 0
14494 1ffeeb91c55d check-code: flag 0/1 used as constant Boolean expression Martin Geisler <mg@lazybytes.net> parents: 14322 diff changeset	299 while True:
40719 9d88ae5c635b perf: add a `setup` argument to run code outside of the timed section Boris Feld <boris.feld@octobus.net> parents: 40718 diff changeset	300 if setup is not None:
9d88ae5c635b perf: add a `setup` argument to run code outside of the timed section Boris Feld <boris.feld@octobus.net> parents: 40718 diff changeset	301 setup()
40144 acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	302 with timeone() as item:
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	303 r = func()
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	304 count += 1
acf560bc9b56 perf: extract the timing of a section in a context manager Boris Feld <boris.feld@octobus.net> parents: 40143 diff changeset	305 results.append(item[0])
30995 22fbca1d11ed mercurial: switch to util.timer for all interval timings Simon Farnsworth <simonfar@fb.com> parents: 30914 diff changeset	306 cstop = util.timer()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	307 if cstop - begin > 3 and count >= 100:
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	308 break
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	309 if cstop - begin > 10 and count >= 3:
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	310 break
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	311
40145 21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	312 formatone(fm, results, title=title, result=r,
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	313 displayall=displayall)
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	314
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	315 def formatone(fm, timings, title=None, result=None, displayall=False):
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	316
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	317 count = len(timings)
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	318
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	319 fm.startitem()
8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	320
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	321 if title:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	322 fm.write(b'title', b'! %s\n', title)
40145 21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	323 if result:
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	324 fm.write(b'result', b'! result: %s\n', result)
38694 55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	325 def display(role, entry):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	326 prefix = b''
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	327 if role != b'best':
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	328 prefix = b'%s.' % role
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	329 fm.plain(b'!')
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	330 fm.write(prefix + b'wall', b' wall %f', entry[0])
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	331 fm.write(prefix + b'comb', b' comb %f', entry[1] + entry[2])
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	332 fm.write(prefix + b'user', b' user %f', entry[1])
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	333 fm.write(prefix + b'sys', b' sys %f', entry[2])
40141 8643219146e1 perf: fix -T json Boris Feld <boris.feld@octobus.net> parents: 39830 diff changeset	334 fm.write(prefix + b'count', b' (%s of %%d)' % role, count)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	335 fm.plain(b'\n')
40145 21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	336 timings.sort()
21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	337 min_val = timings[0]
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	338 display(b'best', min_val)
38694 55101513ed94 perf: add a 'perf.all-timing' option to display more than best time Boris Feld <boris.feld@octobus.net> parents: 38693 diff changeset	339 if displayall:
40145 21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	340 max_val = timings[-1]
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	341 display(b'max', max_val)
40145 21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	342 avg = tuple([sum(x) / count for x in zip(*timings)])
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	343 display(b'avg', avg)
40145 21261fc0fb2b perf: extract result formatting in its own function Boris Feld <boris.feld@octobus.net> parents: 40144 diff changeset	344 median = timings[len(timings) // 2]
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	345 display(b'median', median)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	346
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	347 # utilities for historical portability
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	348
30149 d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	349 def getint(ui, section, name, default):
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	350 # for "historical portability":
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	351 # ui.configint has been available since 1.9 (or fa2b596db182)
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	352 v = ui.config(section, name, None)
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	353 if v is None:
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	354 return default
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	355 try:
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	356 return int(v)
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	357 except ValueError:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	358 raise error.ConfigError((b"%s.%s is not an integer ('%s')")
30149 d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	359 % (section, name, v))
d8a2c536dd96 perf: replace ui.configint() by getint() for Mercurial earlier than 1.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30148 diff changeset	360
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	361 def safeattrsetter(obj, name, ignoremissing=False):
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	362 """Ensure that 'obj' has 'name' attribute before subsequent setattr
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	363
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	364 This function is aborted, if 'obj' doesn't have 'name' attribute
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	365 at runtime. This avoids overlooking removal of an attribute, which
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	366 breaks assumption of performance measurement, in the future.
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	367
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	368 This function returns the object to (1) assign a new value, and
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	369 (2) restore an original value to the attribute.
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	370
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	371 If 'ignoremissing' is true, missing 'name' attribute doesn't cause
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	372 abortion, and this function returns None. This is useful to
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	373 examine an attribute, which isn't ensured in all Mercurial
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	374 versions.
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	375 """
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	376 if not util.safehasattr(obj, name):
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	377 if ignoremissing:
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	378 return None
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	379 raise error.Abort((b"missing attribute %s of %s might break assumption"
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	380 b" of performance measurement") % (name, obj))
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	381
39826 6787dc1b93a9 py3: handle sysstr conversion around get/set attr in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39779 diff changeset	382 origvalue = getattr(obj, _sysstr(name))
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	383 class attrutil(object):
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	384 def set(self, newvalue):
39826 6787dc1b93a9 py3: handle sysstr conversion around get/set attr in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39779 diff changeset	385 setattr(obj, _sysstr(name), newvalue)
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	386 def restore(self):
39826 6787dc1b93a9 py3: handle sysstr conversion around get/set attr in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39779 diff changeset	387 setattr(obj, _sysstr(name), origvalue)
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	388
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	389 return attrutil()
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	390
30144 14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	391 # utilities to examine each internal API changes
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	392
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	393 def getbranchmapsubsettable():
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	394 # for "historical portability":
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	395 # subsettable is defined in:
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	396 # - branchmap since 2.9 (or 175c6fd8cacc)
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	397 # - repoview since 2.5 (or 59a9f18d4587)
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	398 for mod in (branchmap, repoview):
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	399 subsettable = getattr(mod, 'subsettable', None)
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	400 if subsettable:
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	401 return subsettable
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	402
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	403 # bisecting in bcee63733aad::59a9f18d4587 can reach here (both
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	404 # branchmap and repoview modules exist, but subsettable attribute
14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	405 # doesn't)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	406 raise error.Abort((b"perfbranchmap not available with this Mercurial"),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	407 hint=b"use 2.5 or later")
30144 14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	408
30146 148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	409 def getsvfs(repo):
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	410 """Return appropriate object to access files under .hg/store
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	411 """
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	412 # for "historical portability":
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	413 # repo.svfs has been available since 2.3 (or 7034365089bf)
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	414 svfs = getattr(repo, 'svfs', None)
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	415 if svfs:
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	416 return svfs
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	417 else:
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	418 return getattr(repo, 'sopener')
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	419
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	420 def getvfs(repo):
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	421 """Return appropriate object to access files under .hg
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	422 """
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	423 # for "historical portability":
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	424 # repo.vfs has been available since 2.3 (or 7034365089bf)
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	425 vfs = getattr(repo, 'vfs', None)
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	426 if vfs:
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	427 return vfs
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	428 else:
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	429 return getattr(repo, 'opener')
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	430
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	431 def repocleartagscachefunc(repo):
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	432 """Return the function to clear tags cache according to repo internal API
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	433 """
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	434 if util.safehasattr(repo, b'_tagscache'): # since 2.0 (or 9dca7653b525)
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	435 # in this case, setattr(repo, '_tagscache', None) or so isn't
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	436 # correct way to clear tags cache, because existing code paths
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	437 # expect _tagscache to be a structured object.
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	438 def clearcache():
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	439 # _tagscache has been filteredpropertycache since 2.5 (or
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	440 # 98c867ac1330), and delattr() can't work in such case
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	441 if b'_tagscache' in vars(repo):
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	442 del repo.__dict__[b'_tagscache']
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	443 return clearcache
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	444
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	445 repotags = safeattrsetter(repo, b'_tags', ignoremissing=True)
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	446 if repotags: # since 1.4 (or 5614a628d173)
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	447 return lambda : repotags.set(None)
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	448
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	449 repotagscache = safeattrsetter(repo, b'tagscache', ignoremissing=True)
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	450 if repotagscache: # since 0.6 (or d7df759d0e97)
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	451 return lambda : repotagscache.set(None)
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	452
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	453 # Mercurial earlier than 0.6 (or d7df759d0e97) logically reaches
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	454 # this point, but it isn't so problematic, because:
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	455 # - repo.tags of such Mercurial isn't "callable", and repo.tags()
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	456 # in perftags() causes failure soon
c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	457 # - perf.py itself has been available since 1.1 (or eb240755386d)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	458 raise error.Abort((b"tags API of this hg command is unknown"))
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	459
32751 6f791ca70640 perf: have a generic "clearstorecache" function Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32730 diff changeset	460 # utilities to clear cache
6f791ca70640 perf: have a generic "clearstorecache" function Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32730 diff changeset	461
40722 d7936a9dad47 perf: make `clearfilecache` helper work with any object Boris Feld <boris.feld@octobus.net> parents: 40721 diff changeset	462 def clearfilecache(obj, attrname):
d7936a9dad47 perf: make `clearfilecache` helper work with any object Boris Feld <boris.feld@octobus.net> parents: 40721 diff changeset	463 unfiltered = getattr(obj, 'unfiltered', None)
d7936a9dad47 perf: make `clearfilecache` helper work with any object Boris Feld <boris.feld@octobus.net> parents: 40721 diff changeset	464 if unfiltered is not None:
d7936a9dad47 perf: make `clearfilecache` helper work with any object Boris Feld <boris.feld@octobus.net> parents: 40721 diff changeset	465 obj = obj.unfiltered()
d7936a9dad47 perf: make `clearfilecache` helper work with any object Boris Feld <boris.feld@octobus.net> parents: 40721 diff changeset	466 if attrname in vars(obj):
d7936a9dad47 perf: make `clearfilecache` helper work with any object Boris Feld <boris.feld@octobus.net> parents: 40721 diff changeset	467 delattr(obj, attrname)
d7936a9dad47 perf: make `clearfilecache` helper work with any object Boris Feld <boris.feld@octobus.net> parents: 40721 diff changeset	468 obj._filecache.pop(attrname, None)
32751 6f791ca70640 perf: have a generic "clearstorecache" function Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32730 diff changeset	469
40740 e4ea63855d5a perf: introduce a function to fully "unload" a changelog Boris Feld <boris.feld@octobus.net> parents: 40739 diff changeset	470 def clearchangelog(repo):
e4ea63855d5a perf: introduce a function to fully "unload" a changelog Boris Feld <boris.feld@octobus.net> parents: 40739 diff changeset	471 if repo is not repo.unfiltered():
e4ea63855d5a perf: introduce a function to fully "unload" a changelog Boris Feld <boris.feld@octobus.net> parents: 40739 diff changeset	472 object.__setattr__(repo, r'_clcachekey', None)
e4ea63855d5a perf: introduce a function to fully "unload" a changelog Boris Feld <boris.feld@octobus.net> parents: 40739 diff changeset	473 object.__setattr__(repo, r'_clcache', None)
e4ea63855d5a perf: introduce a function to fully "unload" a changelog Boris Feld <boris.feld@octobus.net> parents: 40739 diff changeset	474 clearfilecache(repo.unfiltered(), 'changelog')
e4ea63855d5a perf: introduce a function to fully "unload" a changelog Boris Feld <boris.feld@octobus.net> parents: 40739 diff changeset	475
30143 2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	476 # perf commands
2d858c771760 perf: introduce safeattrsetter to replace direct attribute assignment FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30069 diff changeset	477
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	478 @command(b'perfwalk', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	479 def perfwalk(ui, repo, pats, *opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	480 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	481 timer, fm = gettimer(ui, opts)
34349 b3538c03a804 perf: remove fallbacks to ancient versions of dirstate.walk() Martin von Zweigbergk <martinvonz@google.com> parents: 32906 diff changeset	482 m = scmutil.match(repo[None], pats, {})
34350 255c761a52db dirstate: use keyword arguments to clarify walk()'s callers Martin von Zweigbergk <martinvonz@google.com> parents: 34349 diff changeset	483 timer(lambda: len(list(repo.dirstate.walk(m, subrepos=[], unknown=True,
255c761a52db dirstate: use keyword arguments to clarify walk()'s callers Martin von Zweigbergk <martinvonz@google.com> parents: 34349 diff changeset	484 ignored=False))))
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	485 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	486
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	487 @command(b'perfannotate', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	488 def perfannotate(ui, repo, f, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	489 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	490 timer, fm = gettimer(ui, opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	491 fc = repo[b'.'][f]
19292 e0aa6fff8f02 annotate: simplify annotate parent function Durham Goode <durham@fb.com> parents: 18877 diff changeset	492 timer(lambda: len(fc.annotate(True)))
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	493 fm.end()
19292 e0aa6fff8f02 annotate: simplify annotate parent function Durham Goode <durham@fb.com> parents: 18877 diff changeset	494
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	495 @command(b'perfstatus',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	496 [(b'u', b'unknown', False,
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	497 b'ask status to look for unknown files')] + formatteropts)
18033 00ac420f24ee perf: add option to perfstatus to get the status of unknown files Siddharth Agarwal <sid0@fb.com> parents: 17780 diff changeset	498 def perfstatus(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	499 opts = _byteskwargs(opts)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	500 #m = match.always(repo.root, repo.getcwd())
16683 525fdb738975 cleanup: eradicate long lines Brodie Rao <brodie@sf.io> parents: 16414 diff changeset	501 #timer(lambda: sum(map(len, repo.dirstate.status(m, [], False, False,
525fdb738975 cleanup: eradicate long lines Brodie Rao <brodie@sf.io> parents: 16414 diff changeset	502 # False))))
27017 cdc3e437b481 perf: un-bitrot perfstatus Matt Mackall <mpm@selenic.com> parents: 26748 diff changeset	503 timer, fm = gettimer(ui, opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	504 timer(lambda: sum(map(len, repo.status(unknown=opts[b'unknown']))))
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	505 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	506
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	507 @command(b'perfaddremove', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	508 def perfaddremove(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	509 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	510 timer, fm = gettimer(ui, opts)
18871 a2d4ab4f575d perf: add a command to test addremove performance Siddharth Agarwal <sid0@fb.com> parents: 18845 diff changeset	511 try:
a2d4ab4f575d perf: add a command to test addremove performance Siddharth Agarwal <sid0@fb.com> parents: 18845 diff changeset	512 oldquiet = repo.ui.quiet
a2d4ab4f575d perf: add a command to test addremove performance Siddharth Agarwal <sid0@fb.com> parents: 18845 diff changeset	513 repo.ui.quiet = True
23533 891aaa7c0c70 scmutil: pass a matcher to scmutil.addremove() instead of a list of patterns Matt Harbison <matt_harbison@yahoo.com> parents: 23485 diff changeset	514 matcher = scmutil.match(repo[None])
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	515 opts[b'dry_run'] = True
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	516 timer(lambda: scmutil.addremove(repo, matcher, b"", opts))
18871 a2d4ab4f575d perf: add a command to test addremove performance Siddharth Agarwal <sid0@fb.com> parents: 18845 diff changeset	517 finally:
a2d4ab4f575d perf: add a command to test addremove performance Siddharth Agarwal <sid0@fb.com> parents: 18845 diff changeset	518 repo.ui.quiet = oldquiet
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	519 fm.end()
18871 a2d4ab4f575d perf: add a command to test addremove performance Siddharth Agarwal <sid0@fb.com> parents: 18845 diff changeset	520
16785 1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	521 def clearcaches(cl):
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	522 # behave somewhat consistently across internal API changes
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	523 if util.safehasattr(cl, b'clearcaches'):
16785 1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	524 cl.clearcaches()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	525 elif util.safehasattr(cl, b'_nodecache'):
16785 1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	526 from mercurial.node import nullid, nullrev
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	527 cl._nodecache = {nullid: nullrev}
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	528 cl._nodepos = None
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	529
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	530 @command(b'perfheads', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	531 def perfheads(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	532 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	533 timer, fm = gettimer(ui, opts)
16785 1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	534 cl = repo.changelog
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	535 def d():
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	536 len(cl.headrevs())
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	537 clearcaches(cl)
1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	538 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	539 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	540
40778 594e84a2e574 perf: add a `clear-revlogs` flag to `perftags` Boris Feld <boris.feld@octobus.net> parents: 40777 diff changeset	541 @command(b'perftags', formatteropts+
594e84a2e574 perf: add a `clear-revlogs` flag to `perftags` Boris Feld <boris.feld@octobus.net> parents: 40777 diff changeset	542 [
594e84a2e574 perf: add a `clear-revlogs` flag to `perftags` Boris Feld <boris.feld@octobus.net> parents: 40777 diff changeset	543 (b'', b'clear-revlogs', True, b'refresh changelog and manifest'),
594e84a2e574 perf: add a `clear-revlogs` flag to `perftags` Boris Feld <boris.feld@octobus.net> parents: 40777 diff changeset	544 ])
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	545 def perftags(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	546 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	547 timer, fm = gettimer(ui, opts)
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	548 repocleartagscache = repocleartagscachefunc(repo)
40778 594e84a2e574 perf: add a `clear-revlogs` flag to `perftags` Boris Feld <boris.feld@octobus.net> parents: 40777 diff changeset	549 clearrevlogs = opts[b'clear_revlogs']
40721 4369c00a8ee1 perf: move some of the perftags benchmark to the setup function Boris Feld <boris.feld@octobus.net> parents: 40720 diff changeset	550 def s():
40778 594e84a2e574 perf: add a `clear-revlogs` flag to `perftags` Boris Feld <boris.feld@octobus.net> parents: 40777 diff changeset	551 if clearrevlogs:
594e84a2e574 perf: add a `clear-revlogs` flag to `perftags` Boris Feld <boris.feld@octobus.net> parents: 40777 diff changeset	552 clearchangelog(repo)
594e84a2e574 perf: add a `clear-revlogs` flag to `perftags` Boris Feld <boris.feld@octobus.net> parents: 40777 diff changeset	553 clearfilecache(repo.unfiltered(), 'manifest')
30150 c0410814002f perf: make perftags clear tags cache correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30149 diff changeset	554 repocleartagscache()
40721 4369c00a8ee1 perf: move some of the perftags benchmark to the setup function Boris Feld <boris.feld@octobus.net> parents: 40720 diff changeset	555 def t():
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	556 return len(repo.tags())
40721 4369c00a8ee1 perf: move some of the perftags benchmark to the setup function Boris Feld <boris.feld@octobus.net> parents: 40720 diff changeset	557 timer(t, setup=s)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	558 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	559
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	560 @command(b'perfancestors', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	561 def perfancestors(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	562 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	563 timer, fm = gettimer(ui, opts)
16802 7e5d94381cd1 perf: add a perfancestors benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16788 diff changeset	564 heads = repo.changelog.headrevs()
7e5d94381cd1 perf: add a perfancestors benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16788 diff changeset	565 def d():
16866 91f3ac205816 revlog: ancestors(revs) becomes ancestors(revs) (API) Bryan O'Sullivan <bryano@fb.com>* parents: 16858 diff changeset	566 for a in repo.changelog.ancestors(heads):
16802 7e5d94381cd1 perf: add a perfancestors benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16788 diff changeset	567 pass
7e5d94381cd1 perf: add a perfancestors benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16788 diff changeset	568 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	569 fm.end()
16802 7e5d94381cd1 perf: add a perfancestors benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16788 diff changeset	570
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	571 @command(b'perfancestorset', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	572 def perfancestorset(ui, repo, revset, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	573 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	574 timer, fm = gettimer(ui, opts)
18080 486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	575 revs = repo.revs(revset)
486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	576 heads = repo.changelog.headrevs()
486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	577 def d():
18091 f7f8159caad3 ancestor: add lazy membership testing to lazyancestors Siddharth Agarwal <sid0@fb.com> parents: 18080 diff changeset	578 s = repo.changelog.ancestors(heads)
18080 486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	579 for rev in revs:
486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	580 rev in s
486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	581 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	582 fm.end()
18080 486bfb200b3f perf: add command to test performance of membership in ancestor set Siddharth Agarwal <sid0@fb.com> parents: 18062 diff changeset	583
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	584 @command(b'perfbookmarks', formatteropts)
32753 2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	585 def perfbookmarks(ui, repo, **opts):
2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	586 """benchmark parsing bookmarks from disk to memory"""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	587 opts = _byteskwargs(opts)
32753 2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	588 timer, fm = gettimer(ui, opts)
40720 c0a1686d9391 perf: use the new setup function in "perfbookmarks" Boris Feld <boris.feld@octobus.net> parents: 40719 diff changeset	589
c0a1686d9391 perf: use the new setup function in "perfbookmarks" Boris Feld <boris.feld@octobus.net> parents: 40719 diff changeset	590 def s():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	591 clearfilecache(repo, b'_bookmarks')
40720 c0a1686d9391 perf: use the new setup function in "perfbookmarks" Boris Feld <boris.feld@octobus.net> parents: 40719 diff changeset	592 def d():
32753 2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	593 repo._bookmarks
40720 c0a1686d9391 perf: use the new setup function in "perfbookmarks" Boris Feld <boris.feld@octobus.net> parents: 40719 diff changeset	594 timer(d, setup=s)
32753 2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	595 fm.end()
2b0a8b0f3435 perf: add a perfbookmarks command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32752 diff changeset	596
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	597 @command(b'perfbundleread', formatteropts, b'BUNDLE')
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	598 def perfbundleread(ui, repo, bundlepath, **opts):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	599 """Benchmark reading of bundle files.
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	600
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	601 This command is meant to isolate the I/O part of bundle reading as
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	602 much as possible.
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	603 """
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	604 from mercurial import (
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	605 bundle2,
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	606 exchange,
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	607 streamclone,
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	608 )
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	609
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	610 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	611
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	612 def makebench(fn):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	613 def run():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	614 with open(bundlepath, b'rb') as fh:
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	615 bundle = exchange.readbundle(ui, fh, bundlepath)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	616 fn(bundle)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	617
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	618 return run
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	619
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	620 def makereadnbytes(size):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	621 def run():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	622 with open(bundlepath, b'rb') as fh:
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	623 bundle = exchange.readbundle(ui, fh, bundlepath)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	624 while bundle.read(size):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	625 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	626
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	627 return run
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	628
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	629 def makestdioread(size):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	630 def run():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	631 with open(bundlepath, b'rb') as fh:
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	632 while fh.read(size):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	633 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	634
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	635 return run
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	636
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	637 # bundle1
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	638
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	639 def deltaiter(bundle):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	640 for delta in bundle.deltaiter():
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	641 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	642
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	643 def iterchunks(bundle):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	644 for chunk in bundle.getchunks():
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	645 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	646
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	647 # bundle2
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	648
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	649 def forwardchunks(bundle):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	650 for chunk in bundle._forwardchunks():
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	651 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	652
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	653 def iterparts(bundle):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	654 for part in bundle.iterparts():
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	655 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	656
35137 da91e7309daf bundle2: don't use seekable bundle2 parts by default (issue5691) Gregory Szorc <gregory.szorc@gmail.com> parents: 35132 diff changeset	657 def iterpartsseekable(bundle):
da91e7309daf bundle2: don't use seekable bundle2 parts by default (issue5691) Gregory Szorc <gregory.szorc@gmail.com> parents: 35132 diff changeset	658 for part in bundle.iterparts(seekable=True):
da91e7309daf bundle2: don't use seekable bundle2 parts by default (issue5691) Gregory Szorc <gregory.szorc@gmail.com> parents: 35132 diff changeset	659 pass
da91e7309daf bundle2: don't use seekable bundle2 parts by default (issue5691) Gregory Szorc <gregory.szorc@gmail.com> parents: 35132 diff changeset	660
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	661 def seek(bundle):
35137 da91e7309daf bundle2: don't use seekable bundle2 parts by default (issue5691) Gregory Szorc <gregory.szorc@gmail.com> parents: 35132 diff changeset	662 for part in bundle.iterparts(seekable=True):
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	663 part.seek(0, os.SEEK_END)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	664
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	665 def makepartreadnbytes(size):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	666 def run():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	667 with open(bundlepath, b'rb') as fh:
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	668 bundle = exchange.readbundle(ui, fh, bundlepath)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	669 for part in bundle.iterparts():
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	670 while part.read(size):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	671 pass
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	672
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	673 return run
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	674
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	675 benches = [
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	676 (makestdioread(8192), b'read(8k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	677 (makestdioread(16384), b'read(16k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	678 (makestdioread(32768), b'read(32k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	679 (makestdioread(131072), b'read(128k)'),
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	680 ]
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	681
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	682 with open(bundlepath, b'rb') as fh:
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	683 bundle = exchange.readbundle(ui, fh, bundlepath)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	684
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	685 if isinstance(bundle, changegroup.cg1unpacker):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	686 benches.extend([
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	687 (makebench(deltaiter), b'cg1 deltaiter()'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	688 (makebench(iterchunks), b'cg1 getchunks()'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	689 (makereadnbytes(8192), b'cg1 read(8k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	690 (makereadnbytes(16384), b'cg1 read(16k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	691 (makereadnbytes(32768), b'cg1 read(32k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	692 (makereadnbytes(131072), b'cg1 read(128k)'),
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	693 ])
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	694 elif isinstance(bundle, bundle2.unbundle20):
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	695 benches.extend([
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	696 (makebench(forwardchunks), b'bundle2 forwardchunks()'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	697 (makebench(iterparts), b'bundle2 iterparts()'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	698 (makebench(iterpartsseekable), b'bundle2 iterparts() seekable'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	699 (makebench(seek), b'bundle2 part seek()'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	700 (makepartreadnbytes(8192), b'bundle2 part read(8k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	701 (makepartreadnbytes(16384), b'bundle2 part read(16k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	702 (makepartreadnbytes(32768), b'bundle2 part read(32k)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	703 (makepartreadnbytes(131072), b'bundle2 part read(128k)'),
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	704 ])
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	705 elif isinstance(bundle, streamclone.streamcloneapplier):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	706 raise error.Abort(b'stream clone bundles not supported')
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	707 else:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	708 raise error.Abort(b'unhandled bundle type: %s' % type(bundle))
35132 e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	709
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	710 for fn, title in benches:
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	711 timer, fm = gettimer(ui, opts)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	712 timer(fn, title=title)
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	713 fm.end()
e96613048bdd perf: add command to benchmark bundle reading Gregory Szorc <gregory.szorc@gmail.com> parents: 35107 diff changeset	714
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	715 @command(b'perfchangegroupchangelog', formatteropts +
40752 cfaf3843491b perf: rename version flag of perfchangegroupchangelog to cgversion Pulkit Goyal <pulkit@yandex-team.ru> parents: 40741 diff changeset	716 [(b'', b'cgversion', b'02', b'changegroup version'),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	717 (b'r', b'rev', b'', b'revisions to add to changegroup')])
40752 cfaf3843491b perf: rename version flag of perfchangegroupchangelog to cgversion Pulkit Goyal <pulkit@yandex-team.ru> parents: 40741 diff changeset	718 def perfchangegroupchangelog(ui, repo, cgversion=b'02', rev=None, **opts):
30020 bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	719 """Benchmark producing a changelog group for a changegroup.
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	720
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	721 This measures the time spent processing the changelog during a
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	722 bundle operation. This occurs during `hg bundle` and on a server
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	723 processing a `getbundle` wire protocol request (handles clones
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	724 and pull requests).
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	725
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	726 By default, all revisions are added to the changegroup.
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	727 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	728 opts = _byteskwargs(opts)
30020 bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	729 cl = repo.changelog
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	730 nodes = [cl.lookup(r) for r in repo.revs(rev or b'all()')]
40752 cfaf3843491b perf: rename version flag of perfchangegroupchangelog to cgversion Pulkit Goyal <pulkit@yandex-team.ru> parents: 40741 diff changeset	731 bundler = changegroup.getbundler(cgversion, repo)
30020 bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	732
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	733 def d():
39015 a1f694779b2f perf: call _generatechangelog() instead of group() Gregory Szorc <gregory.szorc@gmail.com> parents: 39007 diff changeset	734 state, chunks = bundler._generatechangelog(cl, nodes)
a1f694779b2f perf: call _generatechangelog() instead of group() Gregory Szorc <gregory.szorc@gmail.com> parents: 39007 diff changeset	735 for chunk in chunks:
30020 bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	736 pass
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	737
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	738 timer, fm = gettimer(ui, opts)
39015 a1f694779b2f perf: call _generatechangelog() instead of group() Gregory Szorc <gregory.szorc@gmail.com> parents: 39007 diff changeset	739
a1f694779b2f perf: call _generatechangelog() instead of group() Gregory Szorc <gregory.szorc@gmail.com> parents: 39007 diff changeset	740 # Terminal printing can interfere with timing. So disable it.
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	741 with ui.configoverride({(b'progress', b'disable'): True}):
39015 a1f694779b2f perf: call _generatechangelog() instead of group() Gregory Szorc <gregory.szorc@gmail.com> parents: 39007 diff changeset	742 timer(d)
a1f694779b2f perf: call _generatechangelog() instead of group() Gregory Szorc <gregory.szorc@gmail.com> parents: 39007 diff changeset	743
30020 bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	744 fm.end()
bd6df07ccc24 perf: add perfchangegroupchangelog command Gregory Szorc <gregory.szorc@gmail.com> parents: 30019 diff changeset	745
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	746 @command(b'perfdirs', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	747 def perfdirs(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	748 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	749 timer, fm = gettimer(ui, opts)
18845 c1f416e4bc80 perf: add perfdirs command Bryan O'Sullivan <bryano@fb.com> parents: 18837 diff changeset	750 dirstate = repo.dirstate
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	751 b'a' in dirstate
18845 c1f416e4bc80 perf: add perfdirs command Bryan O'Sullivan <bryano@fb.com> parents: 18837 diff changeset	752 def d():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	753 dirstate.hasdir(b'a')
35107 61888bd0b300 dirstate: add explicit methods for querying directories (API) Mark Thomas <mbthomas@fb.com> parents: 34750 diff changeset	754 del dirstate._map._dirs
18845 c1f416e4bc80 perf: add perfdirs command Bryan O'Sullivan <bryano@fb.com> parents: 18837 diff changeset	755 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	756 fm.end()
18845 c1f416e4bc80 perf: add perfdirs command Bryan O'Sullivan <bryano@fb.com> parents: 18837 diff changeset	757
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	758 @command(b'perfdirstate', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	759 def perfdirstate(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	760 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	761 timer, fm = gettimer(ui, opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	762 b"a" in repo.dirstate
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	763 def d():
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	764 repo.dirstate.invalidate()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	765 b"a" in repo.dirstate
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	766 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	767 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	768
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	769 @command(b'perfdirstatedirs', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	770 def perfdirstatedirs(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	771 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	772 timer, fm = gettimer(ui, opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	773 b"a" in repo.dirstate
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	774 def d():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	775 repo.dirstate.hasdir(b"a")
35107 61888bd0b300 dirstate: add explicit methods for querying directories (API) Mark Thomas <mbthomas@fb.com> parents: 34750 diff changeset	776 del repo.dirstate._map._dirs
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	777 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	778 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	779
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	780 @command(b'perfdirstatefoldmap', formatteropts)
27095 aaf4e2d77148 contrib/perf: name functions to match decorators timeless <timeless@mozdev.org> parents: 27072 diff changeset	781 def perfdirstatefoldmap(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	782 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	783 timer, fm = gettimer(ui, opts)
22780 d8ff1f671aed perf: add a way to measure the perf of constructing the foldmap Siddharth Agarwal <sid0@fb.com> parents: 20846 diff changeset	784 dirstate = repo.dirstate
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	785 b'a' in dirstate
22780 d8ff1f671aed perf: add a way to measure the perf of constructing the foldmap Siddharth Agarwal <sid0@fb.com> parents: 20846 diff changeset	786 def d():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	787 dirstate._map.filefoldmap.get(b'a')
34676 bfddc3d678ae dirstate: remove _filefoldmap property cache Durham Goode <durham@fb.com> parents: 34494 diff changeset	788 del dirstate._map.filefoldmap
24607 f5b527024fcc perf: make measuring foldmap perf work again Siddharth Agarwal <sid0@fb.com> parents: 24349 diff changeset	789 timer(d)
f5b527024fcc perf: make measuring foldmap perf work again Siddharth Agarwal <sid0@fb.com> parents: 24349 diff changeset	790 fm.end()
f5b527024fcc perf: make measuring foldmap perf work again Siddharth Agarwal <sid0@fb.com> parents: 24349 diff changeset	791
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	792 @command(b'perfdirfoldmap', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	793 def perfdirfoldmap(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	794 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	795 timer, fm = gettimer(ui, opts)
24607 f5b527024fcc perf: make measuring foldmap perf work again Siddharth Agarwal <sid0@fb.com> parents: 24349 diff changeset	796 dirstate = repo.dirstate
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	797 b'a' in dirstate
24607 f5b527024fcc perf: make measuring foldmap perf work again Siddharth Agarwal <sid0@fb.com> parents: 24349 diff changeset	798 def d():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	799 dirstate._map.dirfoldmap.get(b'a')
34678 e8a89ed7ce96 dirstate: move the _dirfoldmap to dirstatemap Durham Goode <durham@fb.com> parents: 34677 diff changeset	800 del dirstate._map.dirfoldmap
35107 61888bd0b300 dirstate: add explicit methods for querying directories (API) Mark Thomas <mbthomas@fb.com> parents: 34750 diff changeset	801 del dirstate._map._dirs
22780 d8ff1f671aed perf: add a way to measure the perf of constructing the foldmap Siddharth Agarwal <sid0@fb.com> parents: 20846 diff changeset	802 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	803 fm.end()
22780 d8ff1f671aed perf: add a way to measure the perf of constructing the foldmap Siddharth Agarwal <sid0@fb.com> parents: 20846 diff changeset	804
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	805 @command(b'perfdirstatewrite', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	806 def perfdirstatewrite(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	807 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	808 timer, fm = gettimer(ui, opts)
16788 7e72c1609862 perf: add a perfdirstatewrite benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16785 diff changeset	809 ds = repo.dirstate
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	810 b"a" in ds
16788 7e72c1609862 perf: add a perfdirstatewrite benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16785 diff changeset	811 def d():
7e72c1609862 perf: add a perfdirstatewrite benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16785 diff changeset	812 ds._dirty = True
26748 5ba0a99ff27f dirstate: make dirstate.write() callers pass transaction object to it FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25850 diff changeset	813 ds.write(repo.currenttransaction())
16788 7e72c1609862 perf: add a perfdirstatewrite benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16785 diff changeset	814 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	815 fm.end()
16788 7e72c1609862 perf: add a perfdirstatewrite benchmark Bryan O'Sullivan <bryano@fb.com> parents: 16785 diff changeset	816
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	817 @command(b'perfmergecalculate',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	818 [(b'r', b'rev', b'.', b'rev to merge against')] + formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	819 def perfmergecalculate(ui, repo, rev, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	820 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	821 timer, fm = gettimer(ui, opts)
18817 c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	822 wctx = repo[None]
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	823 rctx = scmutil.revsingle(repo, rev, rev)
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	824 ancestor = wctx.ancestor(rctx)
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	825 # we don't want working dir files to be stat'd in the benchmark, so prime
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	826 # that cache
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	827 wctx.dirty()
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	828 def d():
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	829 # acceptremote is True because we don't want prompts in the middle of
c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	830 # our benchmark
27098 64cb281d23a5 contrib/perf: fix perfmergecalculate timeless <timeless@mozdev.org> parents: 27097 diff changeset	831 merge.calculateupdates(repo, wctx, rctx, [ancestor], False, False,
27345 98266b1d144d merge: restate calculateupdates in terms of a matcher Augie Fackler <augie@google.com> parents: 27308 diff changeset	832 acceptremote=True, followcopies=True)
18817 c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	833 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	834 fm.end()
18817 c760acc6f69d perf: add a command to measure merge.calculateupdates perf Siddharth Agarwal <sid0@fb.com> parents: 18644 diff changeset	835
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	836 @command(b'perfpathcopies', [], b"REV REV")
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	837 def perfpathcopies(ui, repo, rev1, rev2, **opts):
40773 dc3ab5e5fe64 perf: add a docstring to `perfpathcopies` Boris Feld <boris.feld@octobus.net> parents: 40765 diff changeset	838 """benchmark the copy tracing logic"""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	839 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	840 timer, fm = gettimer(ui, opts)
18877 2e9fe9e2671f perf: add a command to test copies.pathcopies perf Siddharth Agarwal <sid0@fb.com> parents: 18871 diff changeset	841 ctx1 = scmutil.revsingle(repo, rev1, rev1)
2e9fe9e2671f perf: add a command to test copies.pathcopies perf Siddharth Agarwal <sid0@fb.com> parents: 18871 diff changeset	842 ctx2 = scmutil.revsingle(repo, rev2, rev2)
2e9fe9e2671f perf: add a command to test copies.pathcopies perf Siddharth Agarwal <sid0@fb.com> parents: 18871 diff changeset	843 def d():
2e9fe9e2671f perf: add a command to test copies.pathcopies perf Siddharth Agarwal <sid0@fb.com> parents: 18871 diff changeset	844 copies.pathcopies(ctx1, ctx2)
2e9fe9e2671f perf: add a command to test copies.pathcopies perf Siddharth Agarwal <sid0@fb.com> parents: 18871 diff changeset	845 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	846 fm.end()
18877 2e9fe9e2671f perf: add a command to test copies.pathcopies perf Siddharth Agarwal <sid0@fb.com> parents: 18871 diff changeset	847
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	848 @command(b'perfphases',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	849 [(b'', b'full', False, b'include file reading time too'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	850 ], b"")
32501 ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	851 def perfphases(ui, repo, **opts):
ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	852 """benchmark phasesets computation"""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	853 opts = _byteskwargs(opts)
32501 ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	854 timer, fm = gettimer(ui, opts)
32752 e36569bd9e28 perfphases: add a flag to also include file access time Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32751 diff changeset	855 _phases = repo._phasecache
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	856 full = opts.get(b'full')
32501 ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	857 def d():
32752 e36569bd9e28 perfphases: add a flag to also include file access time Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32751 diff changeset	858 phases = _phases
e36569bd9e28 perfphases: add a flag to also include file access time Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32751 diff changeset	859 if full:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	860 clearfilecache(repo, b'_phasecache')
32752 e36569bd9e28 perfphases: add a flag to also include file access time Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32751 diff changeset	861 phases = repo._phasecache
32501 ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	862 phases.invalidate()
ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	863 phases.loadphaserevs(repo)
ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	864 timer(d)
ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	865 fm.end()
ad37c569ec81 perfphases: add 'perfphases' command Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32428 diff changeset	866
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	867 @command(b'perfphasesremote',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	868 [], b"[DEST]")
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	869 def perfphasesremote(ui, repo, dest=None, **opts):
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	870 """benchmark time needed to analyse phases of the remote server"""
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	871 from mercurial.node import (
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	872 bin,
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	873 )
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	874 from mercurial import (
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	875 exchange,
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	876 hg,
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	877 phases,
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	878 )
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	879 opts = _byteskwargs(opts)
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	880 timer, fm = gettimer(ui, opts)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	881
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	882 path = ui.paths.getpath(dest, default=(b'default-push', b'default'))
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	883 if not path:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	884 raise error.Abort((b'default repository not configured!'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	885 hint=(b"see 'hg help config.paths'"))
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	886 dest = path.pushloc or path.loc
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	887 branches = (path.branch, opts.get(b'branch') or [])
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	888 ui.status((b'analysing phase of %s\n') % util.hidepassword(dest))
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	889 revs, checkout = hg.addbranchrevs(repo, repo, branches, opts.get(b'rev'))
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	890 other = hg.peer(repo, opts, dest)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	891
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	892 # easier to perform discovery through the operation
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	893 op = exchange.pushoperation(repo, other)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	894 exchange._pushdiscoverychangeset(op)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	895
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	896 remotesubset = op.fallbackheads
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	897
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	898 with other.commandexecutor() as e:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	899 remotephases = e.callcommand(b'listkeys',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	900 {b'namespace': b'phases'}).result()
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	901 del other
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	902 publishing = remotephases.get(b'publishing', False)
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	903 if publishing:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	904 ui.status((b'publishing: yes\n'))
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	905 else:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	906 ui.status((b'publishing: no\n'))
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	907
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	908 nodemap = repo.changelog.nodemap
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	909 nonpublishroots = 0
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	910 for nhex, phase in remotephases.iteritems():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	911 if nhex == b'publishing': # ignore data related to publish option
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	912 continue
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	913 node = bin(nhex)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	914 if node in nodemap and int(phase):
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	915 nonpublishroots += 1
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	916 ui.status((b'number of roots: %d\n') % len(remotephases))
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	917 ui.status((b'number of known non public roots: %d\n') % nonpublishroots)
38771 1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	918 def d():
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	919 phases.remotephasessummary(repo,
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	920 remotesubset,
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	921 remotephases)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	922 timer(d)
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	923 fm.end()
1732db2f8210 perf: add a perfphasesremote command Boris Feld <boris.feld@octobus.net> parents: 38695 diff changeset	924
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	925 @command(b'perfmanifest',[
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	926 (b'm', b'manifest-rev', False, b'Look up a manifest node revision'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	927 (b'', b'clear-disk', False, b'clear on-disk caches too'),
40142 25ce80ce84c5 perf: accept formatter option for perfmanifest Boris Feld <boris.feld@octobus.net> parents: 40141 diff changeset	928 ] + formatteropts, b'REV\|NODE')
38820 ddb15a83ae0b debug: allow specifying a manifest node rather than a revision Martijn Pieters <mj@zopatista.com> parents: 38819 diff changeset	929 def perfmanifest(ui, repo, rev, manifest_rev=False, clear_disk=False, **opts):
38693 9b6a708f2263 perf: document the perfmanifest command Boris Feld <boris.feld@octobus.net> parents: 38285 diff changeset	930 """benchmark the time to read a manifest from disk and return a usable
9b6a708f2263 perf: document the perfmanifest command Boris Feld <boris.feld@octobus.net> parents: 38285 diff changeset	931 dict-like object
9b6a708f2263 perf: document the perfmanifest command Boris Feld <boris.feld@octobus.net> parents: 38285 diff changeset	932
9b6a708f2263 perf: document the perfmanifest command Boris Feld <boris.feld@octobus.net> parents: 38285 diff changeset	933 Manifest caches are cleared before retrieval."""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	934 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	935 timer, fm = gettimer(ui, opts)
38820 ddb15a83ae0b debug: allow specifying a manifest node rather than a revision Martijn Pieters <mj@zopatista.com> parents: 38819 diff changeset	936 if not manifest_rev:
ddb15a83ae0b debug: allow specifying a manifest node rather than a revision Martijn Pieters <mj@zopatista.com> parents: 38819 diff changeset	937 ctx = scmutil.revsingle(repo, rev, rev)
ddb15a83ae0b debug: allow specifying a manifest node rather than a revision Martijn Pieters <mj@zopatista.com> parents: 38819 diff changeset	938 t = ctx.manifestnode()
ddb15a83ae0b debug: allow specifying a manifest node rather than a revision Martijn Pieters <mj@zopatista.com> parents: 38819 diff changeset	939 else:
39345 c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	940 from mercurial.node import bin
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	941
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	942 if len(rev) == 40:
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	943 t = bin(rev)
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	944 else:
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	945 try:
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	946 rev = int(rev)
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	947
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	948 if util.safehasattr(repo.manifestlog, b'getstorage'):
39345 c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	949 t = repo.manifestlog.getstorage(b'').node(rev)
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	950 else:
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	951 t = repo.manifestlog._revlog.lookup(rev)
c03c5f528e9b perf: use storage API for resolving manifest node Gregory Szorc <gregory.szorc@gmail.com> parents: 39226 diff changeset	952 except ValueError:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	953 raise error.Abort(b'manifest revision must be integer or full '
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	954 b'node')
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	955 def d():
38821 0a57945aaf7f manifest: persist the manifestfulltext cache Martijn Pieters <mj@zopatista.com> parents: 38820 diff changeset	956 repo.manifestlog.clearcaches(clear_persisted_data=clear_disk)
30379 d79c141fdf41 manifest: remove usages of manifest.read Durham Goode <durham@fb.com> parents: 30347 diff changeset	957 repo.manifestlog[t].read()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	958 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	959 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	960
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	961 @command(b'perfchangeset', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	962 def perfchangeset(ui, repo, rev, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	963 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	964 timer, fm = gettimer(ui, opts)
37355 5bcd5859b505 perf: make perfmanifest and perfnodelookup work with revsets Martin von Zweigbergk <martinvonz@google.com> parents: 37271 diff changeset	965 n = scmutil.revsingle(repo, rev).node()
16262 bf7a6c3b2a4a perf: add perfchangeset to time changeset parsing Matt Mackall <mpm@selenic.com> parents: 16260 diff changeset	966 def d():
19378 9de689d20230 cleanup: drop unused variables and an unused import Simon Heimberg <simohe@besonet.ch> parents: 19322 diff changeset	967 repo.changelog.read(n)
16266 77d56a5e74a5 perf: add a changeset test Matt Mackall <mpm@selenic.com> parents: 16262 diff changeset	968 #repo.changelog._cache = None
16262 bf7a6c3b2a4a perf: add perfchangeset to time changeset parsing Matt Mackall <mpm@selenic.com> parents: 16260 diff changeset	969 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	970 fm.end()
16262 bf7a6c3b2a4a perf: add perfchangeset to time changeset parsing Matt Mackall <mpm@selenic.com> parents: 16260 diff changeset	971
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	972 @command(b'perfindex', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	973 def perfindex(ui, repo, **opts):
13255 2696730ca233 perf: make perfindex results useful on hg with lazyparser Matt Mackall <mpm@selenic.com> parents: 13254 diff changeset	974 import mercurial.revlog
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	975 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	976 timer, fm = gettimer(ui, opts)
13277 9f707b297b0f perf: restore lazyindex hack Matt Mackall <mpm@selenic.com> parents: 13262 diff changeset	977 mercurial.revlog._prereadsize = 2**24 # disable lazy parser in old hg
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	978 n = repo[b"tip"].node()
30146 148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	979 svfs = getsvfs(repo)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	980 def d():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	981 cl = mercurial.revlog.revlog(svfs, b"00changelog.i")
16260 33fcad3cfbbc perf: tweak tests for testing index performance improvements Matt Mackall <mpm@selenic.com> parents: 14671 diff changeset	982 cl.rev(n)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	983 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	984 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	985
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	986 @command(b'perfstartup', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	987 def perfstartup(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	988 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	989 timer, fm = gettimer(ui, opts)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	990 def d():
39829 db875f97a969 py3: un-byteify strings around os.system() and os.devnull in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39828 diff changeset	991 if os.name != r'nt':
40349 1524c305377f py3: restore perfstartup() prior to b456b2e0ad9f on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 40295 diff changeset	992 os.system(b"HGRCPATH= %s version -q > /dev/null" %
1524c305377f py3: restore perfstartup() prior to b456b2e0ad9f on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 40295 diff changeset	993 fsencode(sys.argv[0]))
27382 de7bcbc68042 perf: adjust perfstartup() for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 27345 diff changeset	994 else:
39829 db875f97a969 py3: un-byteify strings around os.system() and os.devnull in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39828 diff changeset	995 os.environ[r'HGRCPATH'] = r' '
40349 1524c305377f py3: restore perfstartup() prior to b456b2e0ad9f on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 40295 diff changeset	996 os.system(r"%s version -q > NUL" % sys.argv[0])
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	997 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	998 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	999
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1000 @command(b'perfparents', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1001 def perfparents(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1002 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1003 timer, fm = gettimer(ui, opts)
27305 5831cfbf0e33 perf: perfparents honor config perf.parentscount timeless <timeless@mozdev.org> parents: 27304 diff changeset	1004 # control the number of commits perfparents iterates over
5831cfbf0e33 perf: perfparents honor config perf.parentscount timeless <timeless@mozdev.org> parents: 27304 diff changeset	1005 # experimental config: perf.parentscount
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1006 count = getint(ui, b"perf", b"parentscount", 1000)
27305 5831cfbf0e33 perf: perfparents honor config perf.parentscount timeless <timeless@mozdev.org> parents: 27304 diff changeset	1007 if len(repo.changelog) < count:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1008 raise error.Abort(b"repo needs %d commits for this test" % count)
27100 8d5dba93aa4f contrib/perf: perfparents handle filtered repos timeless <timeless@mozdev.org> parents: 27099 diff changeset	1009 repo = repo.unfiltered()
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1010 nl = [repo.changelog.node(i) for i in _xrange(count)]
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	1011 def d():
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	1012 for n in nl:
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	1013 repo.changelog.parents(n)
eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	1014 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1015 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	1016
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1017 @command(b'perfctxfiles', formatteropts)
27095 aaf4e2d77148 contrib/perf: name functions to match decorators timeless <timeless@mozdev.org> parents: 27072 diff changeset	1018 def perfctxfiles(ui, repo, x, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1019 opts = _byteskwargs(opts)
24349 389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1020 x = int(x)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1021 timer, fm = gettimer(ui, opts)
24349 389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1022 def d():
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1023 len(repo[x].files())
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1024 timer(d)
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1025 fm.end()
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1026
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1027 @command(b'perfrawfiles', formatteropts)
27095 aaf4e2d77148 contrib/perf: name functions to match decorators timeless <timeless@mozdev.org> parents: 27072 diff changeset	1028 def perfrawfiles(ui, repo, x, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1029 opts = _byteskwargs(opts)
24349 389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1030 x = int(x)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1031 timer, fm = gettimer(ui, opts)
24349 389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1032 cl = repo.changelog
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1033 def d():
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1034 len(cl.read(x)[3])
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1035 timer(d)
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1036 fm.end()
389693a245fa perf: add methods for timing changeset file list reading Matt Mackall <mpm@selenic.com> parents: 23878 diff changeset	1037
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1038 @command(b'perflookup', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1039 def perflookup(ui, repo, rev, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1040 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1041 timer, fm = gettimer(ui, opts)
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	1042 timer(lambda: len(repo.lookup(rev)))
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1043 fm.end()
7366 eb240755386d Add contrib/perf.py for performance testing Matt Mackall <mpm@selenic.com> parents: diff changeset	1044
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1045 @command(b'perflinelogedits',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1046 [(b'n', b'edits', 10000, b'number of edits'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1047 (b'', b'max-hunk-lines', 10, b'max lines in a hunk'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1048 ], norepo=True)
39007 1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1049 def perflinelogedits(ui, **opts):
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1050 from mercurial import linelog
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1051
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1052 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1053
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1054 edits = opts[b'edits']
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1055 maxhunklines = opts[b'max_hunk_lines']
39007 1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1056
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1057 maxb1 = 100000
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1058 random.seed(0)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1059 randint = random.randint
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1060 currentlines = 0
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1061 arglist = []
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1062 for rev in _xrange(edits):
39007 1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1063 a1 = randint(0, currentlines)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1064 a2 = randint(a1, min(currentlines, a1 + maxhunklines))
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1065 b1 = randint(0, maxb1)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1066 b2 = randint(b1, b1 + maxhunklines)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1067 currentlines += (b2 - b1) - (a2 - a1)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1068 arglist.append((rev, a1, a2, b1, b2))
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1069
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1070 def d():
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1071 ll = linelog.linelog()
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1072 for args in arglist:
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1073 ll.replacelines(*args)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1074
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1075 timer, fm = gettimer(ui, opts)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1076 timer(d)
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1077 fm.end()
1601afbb573c perf: add a command to benchmark linelog edits Jun Wu <quark@fb.com> parents: 38821 diff changeset	1078
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1079 @command(b'perfrevrange', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1080 def perfrevrange(ui, repo, specs, *opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1081 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1082 timer, fm = gettimer(ui, opts)
16858 fdf99e0f60f3 perf: add a benchmark for revrange Bryan O'Sullivan <bryano@fb.com> parents: 16802 diff changeset	1083 revrange = scmutil.revrange
fdf99e0f60f3 perf: add a benchmark for revrange Bryan O'Sullivan <bryano@fb.com> parents: 16802 diff changeset	1084 timer(lambda: len(revrange(repo, specs)))
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1085 fm.end()
16858 fdf99e0f60f3 perf: add a benchmark for revrange Bryan O'Sullivan <bryano@fb.com> parents: 16802 diff changeset	1086
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1087 @command(b'perfnodelookup', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1088 def perfnodelookup(ui, repo, rev, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1089 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1090 timer, fm = gettimer(ui, opts)
16309 e0c1b3ef7c36 perf: node lookup Matt Mackall <mpm@selenic.com> parents: 16266 diff changeset	1091 import mercurial.revlog
e0c1b3ef7c36 perf: node lookup Matt Mackall <mpm@selenic.com> parents: 16266 diff changeset	1092 mercurial.revlog._prereadsize = 2**24 # disable lazy parser in old hg
37355 5bcd5859b505 perf: make perfmanifest and perfnodelookup work with revsets Martin von Zweigbergk <martinvonz@google.com> parents: 37271 diff changeset	1093 n = scmutil.revsingle(repo, rev).node()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1094 cl = mercurial.revlog.revlog(getsvfs(repo), b"00changelog.i")
16414 e8d37b78acfb parsers: use base-16 trie for faster node->rev mapping Bryan O'Sullivan <bryano@fb.com> parents: 16403 diff changeset	1095 def d():
e8d37b78acfb parsers: use base-16 trie for faster node->rev mapping Bryan O'Sullivan <bryano@fb.com> parents: 16403 diff changeset	1096 cl.rev(n)
16785 1dc08dc63c09 perf: rework perfheads and perftags to clear caches Bryan O'Sullivan <bryano@fb.com> parents: 16689 diff changeset	1097 clearcaches(cl)
16414 e8d37b78acfb parsers: use base-16 trie for faster node->rev mapping Bryan O'Sullivan <bryano@fb.com> parents: 16403 diff changeset	1098 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1099 fm.end()
16414 e8d37b78acfb parsers: use base-16 trie for faster node->rev mapping Bryan O'Sullivan <bryano@fb.com> parents: 16403 diff changeset	1100
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1101 @command(b'perflog',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1102 [(b'', b'rename', False, b'ask log to follow renames')
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1103 ] + formatteropts)
27306 bafb1235f505 perf: add optional rev for perflog and perftemplating timeless <timeless@mozdev.org> parents: 27305 diff changeset	1104 def perflog(ui, repo, rev=None, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1105 opts = _byteskwargs(opts)
27306 bafb1235f505 perf: add optional rev for perflog and perftemplating timeless <timeless@mozdev.org> parents: 27305 diff changeset	1106 if rev is None:
bafb1235f505 perf: add optional rev for perflog and perftemplating timeless <timeless@mozdev.org> parents: 27305 diff changeset	1107 rev=[]
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1108 timer, fm = gettimer(ui, opts)
7872 f680a1bd679b contrib: add perflog and perftemplating commands to perf extension Alexander Solovyov <piranha@piranha.org.ua> parents: 7366 diff changeset	1109 ui.pushbuffer()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1110 timer(lambda: commands.log(ui, repo, rev=rev, date=b'', user=b'',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1111 copies=opts.get(b'rename')))
7872 f680a1bd679b contrib: add perflog and perftemplating commands to perf extension Alexander Solovyov <piranha@piranha.org.ua> parents: 7366 diff changeset	1112 ui.popbuffer()
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1113 fm.end()
7872 f680a1bd679b contrib: add perflog and perftemplating commands to perf extension Alexander Solovyov <piranha@piranha.org.ua> parents: 7366 diff changeset	1114
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1115 @command(b'perfmoonwalk', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1116 def perfmoonwalk(ui, repo, **opts):
20178 74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1117 """benchmark walking the changelog backwards
74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1118
74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1119 This also loads the changelog data for each revision in the changelog.
74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1120 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1121 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1122 timer, fm = gettimer(ui, opts)
20178 74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1123 def moonwalk():
38819 a4d847cea6f8 perfmoonwalk: make work with filtered repo Martin von Zweigbergk <martinvonz@google.com> parents: 38695 diff changeset	1124 for i in repo.changelog.revs(start=(len(repo) - 1), stop=-1):
20178 74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1125 ctx = repo[i]
74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1126 ctx.branch() # read changelog data (in addition to the index)
74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1127 timer(moonwalk)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1128 fm.end()
20178 74aea4be8e78 perf: add perfmoonwalk command to walk the changelog backwards Brodie Rao <brodie@sf.io> parents: 20032 diff changeset	1129
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1130 @command(b'perftemplating',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1131 [(b'r', b'rev', [], b'revisions to run the template on'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1132 ] + formatteropts)
38270 ae6e02fcee24 perftemplating: allow to specify the template to test Boris Feld <boris.feld@octobus.net> parents: 38269 diff changeset	1133 def perftemplating(ui, repo, testedtemplate=None, **opts):
ae6e02fcee24 perftemplating: allow to specify the template to test Boris Feld <boris.feld@octobus.net> parents: 38269 diff changeset	1134 """test the rendering time of a given template"""
38269 a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1135 if makelogtemplater is None:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1136 raise error.Abort((b"perftemplating not available with this Mercurial"),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1137 hint=b"use 4.3 or later")
38269 a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1138
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1139 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1140
38267 71d59b487d0c perftemplating: drop usage of buffer Boris Feld <boris.feld@octobus.net> parents: 38266 diff changeset	1141 nullui = ui.copy()
39829 db875f97a969 py3: un-byteify strings around os.system() and os.devnull in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39828 diff changeset	1142 nullui.fout = open(os.devnull, r'wb')
38267 71d59b487d0c perftemplating: drop usage of buffer Boris Feld <boris.feld@octobus.net> parents: 38266 diff changeset	1143 nullui.disablepager()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1144 revs = opts.get(b'rev')
38269 a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1145 if not revs:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1146 revs = [b'all()']
38269 a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1147 revs = list(scmutil.revrange(repo, revs))
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1148
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1149 defaulttemplate = (b'{date\|shortdate} [{rev}:{node\|short}]'
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1150 b' {author\|person}: {desc\|firstline}\n')
38270 ae6e02fcee24 perftemplating: allow to specify the template to test Boris Feld <boris.feld@octobus.net> parents: 38269 diff changeset	1151 if testedtemplate is None:
ae6e02fcee24 perftemplating: allow to specify the template to test Boris Feld <boris.feld@octobus.net> parents: 38269 diff changeset	1152 testedtemplate = defaulttemplate
ae6e02fcee24 perftemplating: allow to specify the template to test Boris Feld <boris.feld@octobus.net> parents: 38269 diff changeset	1153 displayer = makelogtemplater(nullui, repo, testedtemplate)
38266 6b91815fcdce perftemplating: move template formating into its own function Boris Feld <boris.feld@octobus.net> parents: 38265 diff changeset	1154 def format():
38269 a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1155 for r in revs:
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1156 ctx = repo[r]
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1157 displayer.show(ctx)
a577a199983c perftemplating: stop going through the log command Boris Feld <boris.feld@octobus.net> parents: 38268 diff changeset	1158 displayer.flush(ctx)
38266 6b91815fcdce perftemplating: move template formating into its own function Boris Feld <boris.feld@octobus.net> parents: 38265 diff changeset	1159
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1160 timer, fm = gettimer(ui, opts)
38266 6b91815fcdce perftemplating: move template formating into its own function Boris Feld <boris.feld@octobus.net> parents: 38265 diff changeset	1161 timer(format)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1162 fm.end()
7872 f680a1bd679b contrib: add perflog and perftemplating commands to perf extension Alexander Solovyov <piranha@piranha.org.ua> parents: 7366 diff changeset	1163
40774 30d878cb102d perf: rename `perfhelper-tracecopies` to `perfhelper-pathcopies` Boris Feld <boris.feld@octobus.net> parents: 40773 diff changeset	1164 @command(b'perfhelper-pathcopies', formatteropts +
40730 a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1165 [
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1166 (b'r', b'revs', [], b'restrict search to these revisions'),
40765 36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1167 (b'', b'timing', False, b'provides extra data (costly)'),
40730 a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1168 ])
40774 30d878cb102d perf: rename `perfhelper-tracecopies` to `perfhelper-pathcopies` Boris Feld <boris.feld@octobus.net> parents: 40773 diff changeset	1169 def perfhelperpathcopies(ui, repo, revs=[], **opts):
40730 a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1170 """find statistic about potential parameters for the `perftracecopies`
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1171
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1172 This command find source-destination pair relevant for copytracing testing.
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1173 It report value for some of the parameters that impact copy tracing time.
40765 36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1174
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1175 If `--timing` is set, rename detection is run and the associated timing
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1176 will be reported. The extra details comes at the cost of a slower command
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1177 execution.
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1178
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1179 Since the rename detection is only run once, other factors might easily
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1180 affect the precision of the timing. However it should give a good
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1181 approximation of which revision pairs are very costly.
40730 a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1182 """
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1183 opts = _byteskwargs(opts)
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1184 fm = ui.formatter(b'perf', opts)
40765 36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1185 dotiming = opts[b'timing']
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1186
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1187 if dotiming:
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1188 header = '%12s %12s %12s %12s %12s %12s\n'
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1189 output = ("%(source)12s %(destination)12s "
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1190 "%(nbrevs)12d %(nbmissingfiles)12d "
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1191 "%(nbrenamedfiles)12d %(time)18.5f\n")
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1192 header_names = ("source", "destination", "nb-revs", "nb-files",
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1193 "nb-renames", "time")
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1194 fm.plain(header % header_names)
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1195 else:
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1196 header = '%12s %12s %12s %12s\n'
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1197 output = ("%(source)12s %(destination)12s "
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1198 "%(nbrevs)12d %(nbmissingfiles)12d\n")
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1199 fm.plain(header % ("source", "destination", "nb-revs", "nb-files"))
40730 a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1200
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1201 if not revs:
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1202 revs = ['all()']
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1203 revs = scmutil.revrange(repo, revs)
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1204
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1205 roi = repo.revs('merge() and %ld', revs)
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1206 for r in roi:
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1207 ctx = repo[r]
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1208 p1 = ctx.p1().rev()
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1209 p2 = ctx.p2().rev()
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1210 bases = repo.changelog._commonancestorsheads(p1, p2)
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1211 for p in (p1, p2):
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1212 for b in bases:
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1213 base = repo[b]
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1214 parent = repo[p]
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1215 missing = copies._computeforwardmissing(base, parent)
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1216 if not missing:
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1217 continue
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1218 data = {
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1219 b'source': base.hex(),
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1220 b'destination': parent.hex(),
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1221 b'nbrevs': len(repo.revs('%d::%d', b, p)),
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1222 b'nbmissingfiles': len(missing),
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1223 }
40765 36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1224 if dotiming:
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1225 begin = util.timer()
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1226 renames = copies.pathcopies(base, parent)
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1227 end = util.timer()
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1228 # not very stable timing since we did only one run
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1229 data['time'] = end - begin
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1230 data['nbrenamedfiles'] = len(renames)
36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1231 fm.startitem()
40730 a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1232 fm.data(**data)
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1233 out = data.copy()
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1234 out['source'] = fm.hexfunc(base.node())
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1235 out['destination'] = fm.hexfunc(parent.node())
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1236 fm.plain(output % out)
40765 36077a0f6f12 perf: add a `--timing` argument to `perfhelper-tracecopies` Boris Feld <boris.feld@octobus.net> parents: 40760 diff changeset	1237
40730 a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1238 fm.end()
a65fe13de84f perf: add a new `perfhelper-tracecopies` command Boris Feld <boris.feld@octobus.net> parents: 40722 diff changeset	1239
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1240 @command(b'perfcca', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1241 def perfcca(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1242 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1243 timer, fm = gettimer(ui, opts)
17216 01c1ee4bd1dd perf: fix perfcca to work with new casecollisionauditor interface Joshua Redstone <joshua.redstone@fb.com> parents: 16866 diff changeset	1244 timer(lambda: scmutil.casecollisionauditor(ui, False, repo.dirstate))
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1245 fm.end()
16386 ccc173d0914e perf: add case collision auditor perf Matt Mackall <mpm@selenic.com> parents: 16309 diff changeset	1246
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1247 @command(b'perffncacheload', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1248 def perffncacheload(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1249 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1250 timer, fm = gettimer(ui, opts)
17780 769f66861eb8 perf: simply use repo.store for perffncache* commands Adrian Buehlmann <adrian@cadifra.com> parents: 17553 diff changeset	1251 s = repo.store
16403 efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1252 def d():
efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1253 s.fncache._load()
efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1254 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1255 fm.end()
16403 efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1256
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1257 @command(b'perffncachewrite', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1258 def perffncachewrite(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1259 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1260 timer, fm = gettimer(ui, opts)
17780 769f66861eb8 perf: simply use repo.store for perffncache* commands Adrian Buehlmann <adrian@cadifra.com> parents: 17553 diff changeset	1261 s = repo.store
38695 2cdb82e8fb44 perffncachewrite: load fncache after lock is acquired Boris Feld <boris.feld@octobus.net> parents: 38694 diff changeset	1262 lock = repo.lock()
16403 efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1263 s.fncache._load()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1264 tr = repo.transaction(b'perffncachewrite')
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1265 tr.addbackup(b'fncache')
16403 efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1266 def d():
efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1267 s.fncache._dirty = True
27097 b3e24a9c5f9b contrib/perf: fix perffncachewrite timeless <timeless@mozdev.org> parents: 27096 diff changeset	1268 s.fncache.write(tr)
16403 efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1269 timer(d)
30069 98b9846a131e perf: release lock after transaction in perffncachewrite Pierre-Yves David <pierre-yves.david@ens-lyon.org> parents: 30020 diff changeset	1270 tr.close()
27097 b3e24a9c5f9b contrib/perf: fix perffncachewrite timeless <timeless@mozdev.org> parents: 27096 diff changeset	1271 lock.release()
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1272 fm.end()
16403 efae1fea4bbd perf: time fncache read and write performance Bryan O'Sullivan <bryano@fb.com> parents: 16386 diff changeset	1273
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1274 @command(b'perffncacheencode', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1275 def perffncacheencode(ui, repo, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1276 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1277 timer, fm = gettimer(ui, opts)
17780 769f66861eb8 perf: simply use repo.store for perffncache* commands Adrian Buehlmann <adrian@cadifra.com> parents: 17553 diff changeset	1278 s = repo.store
17553 5ab863922e0f perf: add perffncacheencode Adrian Buehlmann <adrian@cadifra.com> parents: 17216 diff changeset	1279 s.fncache._load()
5ab863922e0f perf: add perffncacheencode Adrian Buehlmann <adrian@cadifra.com> parents: 17216 diff changeset	1280 def d():
5ab863922e0f perf: add perffncacheencode Adrian Buehlmann <adrian@cadifra.com> parents: 17216 diff changeset	1281 for p in s.fncache.entries:
5ab863922e0f perf: add perffncacheencode Adrian Buehlmann <adrian@cadifra.com> parents: 17216 diff changeset	1282 s.encode(p)
5ab863922e0f perf: add perffncacheencode Adrian Buehlmann <adrian@cadifra.com> parents: 17216 diff changeset	1283 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1284 fm.end()
17553 5ab863922e0f perf: add perffncacheencode Adrian Buehlmann <adrian@cadifra.com> parents: 17216 diff changeset	1285
36774 d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1286 def _bdiffworker(q, blocks, xdiff, ready, done):
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1287 while not done.is_set():
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1288 pair = q.get()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1289 while pair is not None:
36774 d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1290 if xdiff:
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1291 mdiff.bdiff.xdiffblocks(*pair)
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1292 elif blocks:
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1293 mdiff.bdiff.blocks(*pair)
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1294 else:
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1295 mdiff.textdiff(*pair)
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1296 q.task_done()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1297 pair = q.get()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1298 q.task_done() # for the None one
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1299 with ready:
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1300 ready.wait()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1301
39346 862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1302 def _manifestrevision(repo, mnode):
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1303 ml = repo.manifestlog
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1304
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1305 if util.safehasattr(ml, b'getstorage'):
39346 862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1306 store = ml.getstorage(b'')
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1307 else:
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1308 store = ml._revlog
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1309
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1310 return store.revision(mnode)
862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1311
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1312 @command(b'perfbdiff', revlogopts + formatteropts + [
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1313 (b'', b'count', 1, b'number of revisions to test (when using --startrev)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1314 (b'', b'alldata', False, b'test bdiffs for all associated revisions'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1315 (b'', b'threads', 0, b'number of thread to use (disable with 0)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1316 (b'', b'blocks', False, b'test computing diffs into blocks'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1317 (b'', b'xdiff', False, b'use xdiff algorithm'),
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1318 ],
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1319
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1320 b'-c\|-m\|FILE REV')
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1321 def perfbdiff(ui, repo, file_, rev=None, count=None, threads=0, **opts):
30346 7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1322 """benchmark a bdiff between revisions
7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1323
7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1324 By default, benchmark a bdiff between its delta parent and itself.
7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1325
7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1326 With ``--count``, benchmark bdiffs between delta parents and self for N
7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1327 revisions starting at the specified revision.
30347 6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1328
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1329 With ``--alldata``, assume the requested revision is a changeset and
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1330 measure bdiffs for all changes related to that changeset (manifest
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1331 and filelogs).
30346 7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1332 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1333 opts = _byteskwargs(opts)
36774 d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1334
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1335 if opts[b'xdiff'] and not opts[b'blocks']:
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1336 raise error.CommandError(b'perfbdiff', b'--xdiff requires --blocks')
36774 d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1337
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1338 if opts[b'alldata']:
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1339 opts[b'changelog'] = True
30347 6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1340
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1341 if opts.get(b'changelog') or opts.get(b'manifest'):
30320 c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1342 file_, rev = None, file_
c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1343 elif rev is None:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1344 raise error.CommandError(b'perfbdiff', b'invalid arguments')
30320 c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1345
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1346 blocks = opts[b'blocks']
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1347 xdiff = opts[b'xdiff']
30345 7d91a085ebe6 perf: prepare to handle multiple pairs in perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30320 diff changeset	1348 textpairs = []
7d91a085ebe6 perf: prepare to handle multiple pairs in perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30320 diff changeset	1349
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1350 r = cmdutil.openrevlog(repo, b'perfbdiff', file_, opts)
30320 c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1351
30346 7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1352 startrev = r.rev(r.lookup(rev))
7ddc8f8d7712 perf: support bdiffing multiple revisions in a single revlog Gregory Szorc <gregory.szorc@gmail.com> parents: 30345 diff changeset	1353 for rev in range(startrev, min(startrev + count, len(r) - 1)):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1354 if opts[b'alldata']:
30347 6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1355 # Load revisions associated with changeset.
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1356 ctx = repo[rev]
39346 862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1357 mtext = _manifestrevision(repo, ctx.manifestnode())
30347 6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1358 for pctx in ctx.parents():
39346 862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1359 pman = _manifestrevision(repo, pctx.manifestnode())
30347 6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1360 textpairs.append((pman, mtext))
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1361
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1362 # Load filelog revisions by iterating manifest delta.
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1363 man = ctx.manifest()
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1364 pman = ctx.p1().manifest()
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1365 for filename, change in pman.diff(man).items():
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1366 fctx = repo.file(filename)
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1367 f1 = fctx.revision(change[0][0] or -1)
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1368 f2 = fctx.revision(change[1][0] or -1)
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1369 textpairs.append((f1, f2))
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1370 else:
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1371 dp = r.deltaparent(rev)
6ecad4b73569 perf: support measuring bdiff for all changeset related data Gregory Szorc <gregory.szorc@gmail.com> parents: 30346 diff changeset	1372 textpairs.append((r.revision(dp), r.revision(rev)))
30320 c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1373
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1374 withthreads = threads > 0
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1375 if not withthreads:
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1376 def d():
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1377 for pair in textpairs:
36774 d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1378 if xdiff:
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1379 mdiff.bdiff.xdiffblocks(*pair)
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1380 elif blocks:
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1381 mdiff.bdiff.blocks(*pair)
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1382 else:
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1383 mdiff.textdiff(*pair)
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1384 else:
37890 8fb9985382be pycompat: export queue module instead of symbols in module (API) Gregory Szorc <gregory.szorc@gmail.com> parents: 37355 diff changeset	1385 q = queue()
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1386 for i in _xrange(threads):
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1387 q.put(None)
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1388 ready = threading.Condition()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1389 done = threading.Event()
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1390 for i in _xrange(threads):
36774 d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1391 threading.Thread(target=_bdiffworker,
d382344c69aa perf: teach perfbdiff to call blocks() and to use xdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 36393 diff changeset	1392 args=(q, blocks, xdiff, ready, done)).start()
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1393 q.join()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1394 def d():
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1395 for pair in textpairs:
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1396 q.put(pair)
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1397 for i in _xrange(threads):
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1398 q.put(None)
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1399 with ready:
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1400 ready.notify_all()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1401 q.join()
30320 c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1402 timer, fm = gettimer(ui, opts)
c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1403 timer(d)
c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1404 fm.end()
c8fa7ad1ff90 perf: add perfbdiff Gregory Szorc <gregory.szorc@gmail.com> parents: 30219 diff changeset	1405
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1406 if withthreads:
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1407 done.set()
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1408 for i in _xrange(threads):
35599 af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1409 q.put(None)
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1410 with ready:
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1411 ready.notify_all()
af25237be091 perf: add threading capability to perfbdiff Boris Feld <boris.feld@octobus.net> parents: 35137 diff changeset	1412
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1413 @command(b'perfunidiff', revlogopts + formatteropts + [
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1414 (b'', b'count', 1, b'number of revisions to test (when using --startrev)'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1415 (b'', b'alldata', False, b'test unidiffs for all associated revisions'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1416 ], b'-c\|-m\|FILE REV')
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1417 def perfunidiff(ui, repo, file_, rev=None, count=None, **opts):
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1418 """benchmark a unified diff between revisions
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1419
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1420 This doesn't include any copy tracing - it's just a unified diff
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1421 of the texts.
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1422
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1423 By default, benchmark a diff between its delta parent and itself.
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1424
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1425 With ``--count``, benchmark diffs between delta parents and self for N
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1426 revisions starting at the specified revision.
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1427
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1428 With ``--alldata``, assume the requested revision is a changeset and
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1429 measure diffs for all changes related to that changeset (manifest
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1430 and filelogs).
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1431 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1432 opts = _byteskwargs(opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1433 if opts[b'alldata']:
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1434 opts[b'changelog'] = True
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1435
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1436 if opts.get(b'changelog') or opts.get(b'manifest'):
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1437 file_, rev = None, file_
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1438 elif rev is None:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1439 raise error.CommandError(b'perfunidiff', b'invalid arguments')
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1440
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1441 textpairs = []
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1442
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1443 r = cmdutil.openrevlog(repo, b'perfunidiff', file_, opts)
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1444
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1445 startrev = r.rev(r.lookup(rev))
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1446 for rev in range(startrev, min(startrev + count, len(r) - 1)):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1447 if opts[b'alldata']:
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1448 # Load revisions associated with changeset.
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1449 ctx = repo[rev]
39346 862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1450 mtext = _manifestrevision(repo, ctx.manifestnode())
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1451 for pctx in ctx.parents():
39346 862d23bc5749 perf: add function for obtaining manifest revision Gregory Szorc <gregory.szorc@gmail.com> parents: 39345 diff changeset	1452 pman = _manifestrevision(repo, pctx.manifestnode())
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1453 textpairs.append((pman, mtext))
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1454
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1455 # Load filelog revisions by iterating manifest delta.
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1456 man = ctx.manifest()
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1457 pman = ctx.p1().manifest()
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1458 for filename, change in pman.diff(man).items():
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1459 fctx = repo.file(filename)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1460 f1 = fctx.revision(change[0][0] or -1)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1461 f2 = fctx.revision(change[1][0] or -1)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1462 textpairs.append((f1, f2))
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1463 else:
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1464 dp = r.deltaparent(rev)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1465 textpairs.append((r.revision(dp), r.revision(rev)))
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1466
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1467 def d():
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1468 for left, right in textpairs:
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1469 # The date strings don't matter, so we pass empty strings.
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1470 headerlines, hunks = mdiff.unidiff(
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1471 left, b'', right, b'', b'left', b'right', binary=False)
35901 ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1472 # consume iterators in roughly the way patch.py does
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1473 b'\n'.join(headerlines)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1474 b''.join(sum((list(hlines) for hrange, hlines in hunks), []))
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1475 timer, fm = gettimer(ui, opts)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1476 timer(d)
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1477 fm.end()
ed939545edd0 perf: add a perfunidiff command for benchmarking unified diff speed Augie Fackler <augie@google.com> parents: 35602 diff changeset	1478
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1479 @command(b'perfdiffwd', formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1480 def perfdiffwd(ui, repo, **opts):
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1481 """Profile diff of working directory changes"""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1482 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	1483 timer, fm = gettimer(ui, opts)
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1484 options = {
40214 b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	1485 'w': 'ignore_all_space',
b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	1486 'b': 'ignore_space_change',
b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	1487 'B': 'ignore_blank_lines',
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1488 }
d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1489
40214 b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	1490 for diffopt in ('', 'w', 'b', 'B', 'wB'):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1491 opts = dict((options[c], b'1') for c in diffopt)
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1492 def d():
d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1493 ui.pushbuffer()
d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1494 commands.diff(ui, repo, **opts)
d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1495 ui.popbuffer()
40214 b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	1496 diffopt = diffopt.encode('ascii')
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1497 title = b'diffopts: %s' % (diffopt and (b'-' + diffopt) or b'none')
40718 20d2fd6036ed perf: explicitly pass title as a keyword argument in `perfdiffwd` Boris Feld <boris.feld@octobus.net> parents: 40605 diff changeset	1498 timer(d, title=title)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1499 fm.end()
9826 d768614578dd contrib/perf: profile diff of working directory changes Patrick Mezard <pmezard@gmail.com> parents: 9146 diff changeset	1500
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1501 @command(b'perfrevlogindex', revlogopts + formatteropts,
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1502 b'-c\|-m\|FILE')
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1503 def perfrevlogindex(ui, repo, file_=None, **opts):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1504 """Benchmark operations against a revlog index.
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1505
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1506 This tests constructing a revlog instance, reading index data,
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1507 parsing index data, and performing various operations related to
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1508 index data.
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1509 """
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1510
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1511 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1512
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1513 rl = cmdutil.openrevlog(repo, b'perfrevlogindex', file_, opts)
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1514
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1515 opener = getattr(rl, 'opener') # trick linter
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1516 indexfile = rl.indexfile
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1517 data = opener.read(indexfile)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1518
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1519 header = struct.unpack(b'>I', data[0:4])[0]
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1520 version = header & 0xFFFF
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1521 if version == 1:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1522 revlogio = revlog.revlogio()
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1523 inline = header & (1 << 16)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1524 else:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1525 raise error.Abort((b'unsupported revlog version: %d') % version)
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1526
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1527 rllen = len(rl)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1528
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1529 node0 = rl.node(0)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1530 node25 = rl.node(rllen // 4)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1531 node50 = rl.node(rllen // 2)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1532 node75 = rl.node(rllen // 4 * 3)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1533 node100 = rl.node(rllen - 1)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1534
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1535 allrevs = range(rllen)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1536 allrevsrev = list(reversed(allrevs))
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1537 allnodes = [rl.node(rev) for rev in range(rllen)]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1538 allnodesrev = list(reversed(allnodes))
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1539
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1540 def constructor():
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1541 revlog.revlog(opener, indexfile)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1542
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1543 def read():
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1544 with opener(indexfile) as fh:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1545 fh.read()
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1546
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1547 def parseindex():
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1548 revlogio.parseindex(data, inline)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1549
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1550 def getentry(revornode):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1551 index = revlogio.parseindex(data, inline)[0]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1552 index[revornode]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1553
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1554 def getentries(revs, count=1):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1555 index = revlogio.parseindex(data, inline)[0]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1556
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1557 for i in range(count):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1558 for rev in revs:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1559 index[rev]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1560
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1561 def resolvenode(node):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1562 nodemap = revlogio.parseindex(data, inline)[1]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1563 # This only works for the C code.
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1564 if nodemap is None:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1565 return
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1566
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1567 try:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1568 nodemap[node]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1569 except error.RevlogError:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1570 pass
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1571
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1572 def resolvenodes(nodes, count=1):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1573 nodemap = revlogio.parseindex(data, inline)[1]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1574 if nodemap is None:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1575 return
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1576
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1577 for i in range(count):
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1578 for node in nodes:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1579 try:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1580 nodemap[node]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1581 except error.RevlogError:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1582 pass
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1583
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1584 benches = [
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1585 (constructor, b'revlog constructor'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1586 (read, b'read'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1587 (parseindex, b'create index object'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1588 (lambda: getentry(0), b'retrieve index entry for rev 0'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1589 (lambda: resolvenode(b'a' * 20), b'look up missing node'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1590 (lambda: resolvenode(node0), b'look up node at rev 0'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1591 (lambda: resolvenode(node25), b'look up node at 1/4 len'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1592 (lambda: resolvenode(node50), b'look up node at 1/2 len'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1593 (lambda: resolvenode(node75), b'look up node at 3/4 len'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1594 (lambda: resolvenode(node100), b'look up node at tip'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1595 # 2x variation is to measure caching impact.
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1596 (lambda: resolvenodes(allnodes),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1597 b'look up all nodes (forward)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1598 (lambda: resolvenodes(allnodes, 2),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1599 b'look up all nodes 2x (forward)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1600 (lambda: resolvenodes(allnodesrev),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1601 b'look up all nodes (reverse)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1602 (lambda: resolvenodes(allnodesrev, 2),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1603 b'look up all nodes 2x (reverse)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1604 (lambda: getentries(allrevs),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1605 b'retrieve all index entries (forward)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1606 (lambda: getentries(allrevs, 2),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1607 b'retrieve all index entries 2x (forward)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1608 (lambda: getentries(allrevsrev),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1609 b'retrieve all index entries (reverse)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1610 (lambda: getentries(allrevsrev, 2),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1611 b'retrieve all index entries 2x (reverse)'),
32565 e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1612 ]
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1613
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1614 for fn, title in benches:
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1615 timer, fm = gettimer(ui, opts)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1616 timer(fn, title=title)
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1617 fm.end()
e4f514627514 perf: benchmark command for revlog indexes Gregory Szorc <gregory.szorc@gmail.com> parents: 32564 diff changeset	1618
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1619 @command(b'perfrevlogrevisions', revlogopts + formatteropts +
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1620 [(b'd', b'dist', 100, b'distance between the revisions'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1621 (b's', b'startrev', 0, b'revision to start reading at'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1622 (b'', b'reverse', False, b'read in reverse')],
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1623 b'-c\|-m\|FILE')
32564 7236facefd4f perf: rename perfrevlog to perfrevlogrevisions Gregory Szorc <gregory.szorc@gmail.com> parents: 32501 diff changeset	1624 def perfrevlogrevisions(ui, repo, file_=None, startrev=0, reverse=False,
7236facefd4f perf: rename perfrevlog to perfrevlogrevisions Gregory Szorc <gregory.szorc@gmail.com> parents: 32501 diff changeset	1625 **opts):
27492 ac549d7fbc2b perf: use standard arguments for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27472 diff changeset	1626 """Benchmark reading a series of revisions from a revlog.
ac549d7fbc2b perf: use standard arguments for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27472 diff changeset	1627
ac549d7fbc2b perf: use standard arguments for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27472 diff changeset	1628 By default, we read every ``-d/--dist`` revision from 0 to tip of
ac549d7fbc2b perf: use standard arguments for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27472 diff changeset	1629 the specified revlog.
27493 14b0930105da perf: make start revision configurable for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27492 diff changeset	1630
14b0930105da perf: make start revision configurable for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27492 diff changeset	1631 The start revision can be defined via ``-s/--startrev``.
27492 ac549d7fbc2b perf: use standard arguments for perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 27472 diff changeset	1632 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1633 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1634
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1635 rl = cmdutil.openrevlog(repo, b'perfrevlogrevisions', file_, opts)
32272 4c6b2076d292 perf: move revlog construction and length calculation out of benchmark Gregory Szorc <gregory.szorc@gmail.com> parents: 32271 diff changeset	1636 rllen = getlen(ui)(rl)
30019 973cf6c3de30 perf: add --reverse to perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 29567 diff changeset	1637
40143 d5d28d360a19 pref: support negative indexing in perfrevlogrevisions Boris Feld <boris.feld@octobus.net> parents: 40142 diff changeset	1638 if startrev < 0:
d5d28d360a19 pref: support negative indexing in perfrevlogrevisions Boris Feld <boris.feld@octobus.net> parents: 40142 diff changeset	1639 startrev = rllen + startrev
d5d28d360a19 pref: support negative indexing in perfrevlogrevisions Boris Feld <boris.feld@octobus.net> parents: 40142 diff changeset	1640
11694 bf49d48e4602 perf: add perfrevlog function to check performance of revlog Pradeepkumar Gayam <in3xes@gmail.com> parents: 10493 diff changeset	1641 def d():
32272 4c6b2076d292 perf: move revlog construction and length calculation out of benchmark Gregory Szorc <gregory.szorc@gmail.com> parents: 32271 diff changeset	1642 rl.clearcaches()
30019 973cf6c3de30 perf: add --reverse to perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 29567 diff changeset	1643
32264 6b582f9b6e5e perf: don't clobber startrev variable Gregory Szorc <gregory.szorc@gmail.com> parents: 32246 diff changeset	1644 beginrev = startrev
32272 4c6b2076d292 perf: move revlog construction and length calculation out of benchmark Gregory Szorc <gregory.szorc@gmail.com> parents: 32271 diff changeset	1645 endrev = rllen
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1646 dist = opts[b'dist']
30019 973cf6c3de30 perf: add --reverse to perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 29567 diff changeset	1647
973cf6c3de30 perf: add --reverse to perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 29567 diff changeset	1648 if reverse:
40587 cbd251d479bb perf: fix perfrevlogrevisions --reverse Boris Feld <boris.feld@octobus.net> parents: 40581 diff changeset	1649 beginrev, endrev = endrev - 1, beginrev - 1
30019 973cf6c3de30 perf: add --reverse to perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 29567 diff changeset	1650 dist = -1 * dist
973cf6c3de30 perf: add --reverse to perfrevlog Gregory Szorc <gregory.szorc@gmail.com> parents: 29567 diff changeset	1651
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	1652 for x in _xrange(beginrev, endrev, dist):
32337 d7efaf6275a7 perf: always pass node to revlog.revision() Gregory Szorc <gregory.szorc@gmail.com> parents: 32272 diff changeset	1653 # Old revisions don't support passing int.
d7efaf6275a7 perf: always pass node to revlog.revision() Gregory Szorc <gregory.szorc@gmail.com> parents: 32272 diff changeset	1654 n = rl.node(x)
d7efaf6275a7 perf: always pass node to revlog.revision() Gregory Szorc <gregory.szorc@gmail.com> parents: 32272 diff changeset	1655 rl.revision(n)
11694 bf49d48e4602 perf: add perfrevlog function to check performance of revlog Pradeepkumar Gayam <in3xes@gmail.com> parents: 10493 diff changeset	1656
32265 c68c400d0a2d perf: move gettimer() call Gregory Szorc <gregory.szorc@gmail.com> parents: 32264 diff changeset	1657 timer, fm = gettimer(ui, opts)
11694 bf49d48e4602 perf: add perfrevlog function to check performance of revlog Pradeepkumar Gayam <in3xes@gmail.com> parents: 10493 diff changeset	1658 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	1659 fm.end()
11694 bf49d48e4602 perf: add perfrevlog function to check performance of revlog Pradeepkumar Gayam <in3xes@gmail.com> parents: 10493 diff changeset	1660
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1661 @command(b'perfrevlogwrite', revlogopts + formatteropts +
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1662 [(b's', b'startrev', 1000, b'revision to start writing at'),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1663 (b'', b'stoprev', -1, b'last revision to write'),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1664 (b'', b'count', 3, b'last revision to write'),
40598 4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1665 (b'', b'details', False, b'print timing for every revisions tested'),
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1666 (b'', b'source', b'full', b'the kind of data feed in the revlog'),
40605 4756a33d0d31 perf: add a lazydeltabase option to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40604 diff changeset	1667 (b'', b'lazydeltabase', True, b'try the provided delta first'),
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1668 ],
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1669 b'-c\|-m\|FILE')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1670 def perfrevlogwrite(ui, repo, file_=None, startrev=1000, stoprev=-1, **opts):
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1671 """Benchmark writing a series of revisions to a revlog.
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1672
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1673 Possible source values are:
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1674 * `full`: add from a full text (default).
40601 6c2357029364 perf: add `parent-1` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40600 diff changeset	1675 * `parent-1`: add from a delta to the first parent
40602 b5b3dd4e40c3 perf: add `parent-2` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40601 diff changeset	1676 * `parent-2`: add from a delta to the second parent if it exists
b5b3dd4e40c3 perf: add `parent-2` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40601 diff changeset	1677 (use a delta from the first parent otherwise)
40603 e14d44772fb3 perf: add `parent-smallest` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40602 diff changeset	1678 * `parent-smallest`: add from the smallest delta (either p1 or p2)
40604 355ae096faef perf: add `storage` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40603 diff changeset	1679 * `storage`: add from the existing precomputed deltas
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1680 """
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1681 opts = _byteskwargs(opts)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1682
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1683 rl = cmdutil.openrevlog(repo, b'perfrevlogwrite', file_, opts)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1684 rllen = getlen(ui)(rl)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1685 if startrev < 0:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1686 startrev = rllen + startrev
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1687 if stoprev < 0:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1688 stoprev = rllen + stoprev
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1689
40605 4756a33d0d31 perf: add a lazydeltabase option to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40604 diff changeset	1690 lazydeltabase = opts['lazydeltabase']
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1691 source = opts['source']
40604 355ae096faef perf: add `storage` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40603 diff changeset	1692 validsource = (b'full', b'parent-1', b'parent-2', b'parent-smallest',
355ae096faef perf: add `storage` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40603 diff changeset	1693 b'storage')
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1694 if source not in validsource:
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1695 raise error.Abort('invalid source type: %s' % source)
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1696
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1697 ### actually gather results
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1698 count = opts['count']
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1699 if count <= 0:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1700 raise error.Abort('invalide run count: %d' % count)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1701 allresults = []
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1702 for c in range(count):
40605 4756a33d0d31 perf: add a lazydeltabase option to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40604 diff changeset	1703 timing = _timeonewrite(ui, rl, source, startrev, stoprev, c + 1,
4756a33d0d31 perf: add a lazydeltabase option to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40604 diff changeset	1704 lazydeltabase=lazydeltabase)
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1705 allresults.append(timing)
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1706
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1707 ### consolidate the results in a single list
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1708 results = []
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1709 for idx, (rev, t) in enumerate(allresults[0]):
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1710 ts = [t]
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1711 for other in allresults[1:]:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1712 orev, ot = other[idx]
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1713 assert orev == rev
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1714 ts.append(ot)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1715 results.append((rev, ts))
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1716 resultcount = len(results)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1717
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1718 ### Compute and display relevant statistics
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1719
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1720 # get a formatter
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1721 fm = ui.formatter(b'perf', opts)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1722 displayall = ui.configbool(b"perf", b"all-timing", False)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1723
40598 4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1724 # print individual details if requested
4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1725 if opts['details']:
4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1726 for idx, item in enumerate(results, 1):
4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1727 rev, data = item
4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1728 title = 'revisions #%d of %d, rev %d' % (idx, resultcount, rev)
4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1729 formatone(fm, data, title=title, displayall=displayall)
4dd7edeb3da9 perf: offer full details in perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40597 diff changeset	1730
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1731 # sorts results by median time
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1732 results.sort(key=lambda x: sorted(x[1])[len(x[1]) // 2])
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1733 # list of (name, index) to display)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1734 relevants = [
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1735 ("min", 0),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1736 ("10%", resultcount * 10 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1737 ("25%", resultcount * 25 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1738 ("50%", resultcount * 70 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1739 ("75%", resultcount * 75 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1740 ("90%", resultcount * 90 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1741 ("95%", resultcount * 95 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1742 ("99%", resultcount * 99 // 100),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1743 ("max", -1),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1744 ]
40599 c63081cd3902 perf: only display the total time for perfrevlogwrite if quiet Boris Feld <boris.feld@octobus.net> parents: 40598 diff changeset	1745 if not ui.quiet:
c63081cd3902 perf: only display the total time for perfrevlogwrite if quiet Boris Feld <boris.feld@octobus.net> parents: 40598 diff changeset	1746 for name, idx in relevants:
c63081cd3902 perf: only display the total time for perfrevlogwrite if quiet Boris Feld <boris.feld@octobus.net> parents: 40598 diff changeset	1747 data = results[idx]
c63081cd3902 perf: only display the total time for perfrevlogwrite if quiet Boris Feld <boris.feld@octobus.net> parents: 40598 diff changeset	1748 title = '%s of %d, rev %d' % (name, resultcount, data[0])
c63081cd3902 perf: only display the total time for perfrevlogwrite if quiet Boris Feld <boris.feld@octobus.net> parents: 40598 diff changeset	1749 formatone(fm, data[1], title=title, displayall=displayall)
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1750
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1751 # XXX summing that many float will not be very precise, we ignore this fact
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1752 # for now
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1753 totaltime = []
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1754 for item in allresults:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1755 totaltime.append((sum(x[1][0] for x in item),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1756 sum(x[1][1] for x in item),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1757 sum(x[1][2] for x in item),)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1758 )
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1759 formatone(fm, totaltime, title="total time (%d revs)" % resultcount,
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1760 displayall=displayall)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1761 fm.end()
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1762
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1763 class _faketr(object):
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1764 def add(s, x, y, z=None):
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1765 return None
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1766
40605 4756a33d0d31 perf: add a lazydeltabase option to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40604 diff changeset	1767 def _timeonewrite(ui, orig, source, startrev, stoprev, runidx=None,
4756a33d0d31 perf: add a lazydeltabase option to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40604 diff changeset	1768 lazydeltabase=True):
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1769 timings = []
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1770 tr = _faketr()
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1771 with _temprevlog(ui, orig, startrev) as dest:
40605 4756a33d0d31 perf: add a lazydeltabase option to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40604 diff changeset	1772 dest._lazydeltabase = lazydeltabase
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1773 revs = list(orig.revs(startrev, stoprev))
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1774 total = len(revs)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1775 topic = 'adding'
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1776 if runidx is not None:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1777 topic += ' (run #%d)' % runidx
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1778 for idx, rev in enumerate(revs):
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1779 ui.progress(topic, idx, unit='revs', total=total)
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1780 addargs, addkwargs = _getrevisionseed(orig, rev, tr, source)
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1781 with timeone() as r:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1782 dest.addrawrevision(addargs, *addkwargs)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1783 timings.append((rev, r[0]))
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1784 ui.progress(topic, total, unit='revs', total=total)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1785 ui.progress(topic, None, unit='revs', total=total)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1786 return timings
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1787
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1788 def _getrevisionseed(orig, rev, tr, source):
40602 b5b3dd4e40c3 perf: add `parent-2` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40601 diff changeset	1789 from mercurial.node import nullid
b5b3dd4e40c3 perf: add `parent-2` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40601 diff changeset	1790
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1791 linkrev = orig.linkrev(rev)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1792 node = orig.node(rev)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1793 p1, p2 = orig.parents(node)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1794 flags = orig.flags(rev)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1795 cachedelta = None
40600 631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1796 text = None
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1797
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1798 if source == b'full':
631011ff6771 perf: add the notion of "source" to perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40599 diff changeset	1799 text = orig.revision(rev)
40601 6c2357029364 perf: add `parent-1` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40600 diff changeset	1800 elif source == b'parent-1':
6c2357029364 perf: add `parent-1` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40600 diff changeset	1801 baserev = orig.rev(p1)
6c2357029364 perf: add `parent-1` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40600 diff changeset	1802 cachedelta = (baserev, orig.revdiff(p1, rev))
40602 b5b3dd4e40c3 perf: add `parent-2` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40601 diff changeset	1803 elif source == b'parent-2':
b5b3dd4e40c3 perf: add `parent-2` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40601 diff changeset	1804 parent = p2
b5b3dd4e40c3 perf: add `parent-2` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40601 diff changeset	1805 if p2 == nullid:
b5b3dd4e40c3 perf: add `parent-2` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40601 diff changeset	1806 parent = p1
b5b3dd4e40c3 perf: add `parent-2` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40601 diff changeset	1807 baserev = orig.rev(parent)
b5b3dd4e40c3 perf: add `parent-2` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40601 diff changeset	1808 cachedelta = (baserev, orig.revdiff(parent, rev))
40603 e14d44772fb3 perf: add `parent-smallest` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40602 diff changeset	1809 elif source == b'parent-smallest':
e14d44772fb3 perf: add `parent-smallest` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40602 diff changeset	1810 p1diff = orig.revdiff(p1, rev)
e14d44772fb3 perf: add `parent-smallest` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40602 diff changeset	1811 parent = p1
e14d44772fb3 perf: add `parent-smallest` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40602 diff changeset	1812 diff = p1diff
e14d44772fb3 perf: add `parent-smallest` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40602 diff changeset	1813 if p2 != nullid:
e14d44772fb3 perf: add `parent-smallest` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40602 diff changeset	1814 p2diff = orig.revdiff(p2, rev)
e14d44772fb3 perf: add `parent-smallest` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40602 diff changeset	1815 if len(p1diff) > len(p2diff):
e14d44772fb3 perf: add `parent-smallest` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40602 diff changeset	1816 parent = p2
e14d44772fb3 perf: add `parent-smallest` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40602 diff changeset	1817 diff = p2diff
e14d44772fb3 perf: add `parent-smallest` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40602 diff changeset	1818 baserev = orig.rev(parent)
e14d44772fb3 perf: add `parent-smallest` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40602 diff changeset	1819 cachedelta = (baserev, diff)
40604 355ae096faef perf: add `storage` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40603 diff changeset	1820 elif source == b'storage':
355ae096faef perf: add `storage` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40603 diff changeset	1821 baserev = orig.deltaparent(rev)
355ae096faef perf: add `storage` as possible source for perfrevlogwrite Boris Feld <boris.feld@octobus.net> parents: 40603 diff changeset	1822 cachedelta = (baserev, orig.revdiff(orig.node(baserev), rev))
40597 164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1823
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1824 return ((text, tr, linkrev, p1, p2),
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1825 {'node': node, 'flags': flags, 'cachedelta': cachedelta})
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1826
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1827 @contextlib.contextmanager
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1828 def _temprevlog(ui, orig, truncaterev):
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1829 from mercurial import vfs as vfsmod
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1830
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1831 if orig._inline:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1832 raise error.Abort('not supporting inline revlog (yet)')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1833
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1834 origindexpath = orig.opener.join(orig.indexfile)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1835 origdatapath = orig.opener.join(orig.datafile)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1836 indexname = 'revlog.i'
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1837 dataname = 'revlog.d'
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1838
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1839 tmpdir = tempfile.mkdtemp(prefix='tmp-hgperf-')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1840 try:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1841 # copy the data file in a temporary directory
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1842 ui.debug('copying data in %s\n' % tmpdir)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1843 destindexpath = os.path.join(tmpdir, 'revlog.i')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1844 destdatapath = os.path.join(tmpdir, 'revlog.d')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1845 shutil.copyfile(origindexpath, destindexpath)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1846 shutil.copyfile(origdatapath, destdatapath)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1847
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1848 # remove the data we want to add again
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1849 ui.debug('truncating data to be rewritten\n')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1850 with open(destindexpath, 'ab') as index:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1851 index.seek(0)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1852 index.truncate(truncaterev * orig._io.size)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1853 with open(destdatapath, 'ab') as data:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1854 data.seek(0)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1855 data.truncate(orig.start(truncaterev))
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1856
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1857 # instantiate a new revlog from the temporary copy
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1858 ui.debug('truncating adding to be rewritten\n')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1859 vfs = vfsmod.vfs(tmpdir)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1860 vfs.options = getattr(orig.opener, 'options', None)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1861
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1862 dest = revlog.revlog(vfs,
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1863 indexfile=indexname,
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1864 datafile=dataname)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1865 if dest._inline:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1866 raise error.Abort('not supporting inline revlog (yet)')
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1867 # make sure internals are initialized
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1868 dest.revision(len(dest) - 1)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1869 yield dest
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1870 del dest, vfs
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1871 finally:
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1872 shutil.rmtree(tmpdir, True)
164b2e77f9a5 perf: introduce a perfrevlogwrite command Boris Feld <boris.feld@octobus.net> parents: 40587 diff changeset	1873
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1874 @command(b'perfrevlogchunks', revlogopts + formatteropts +
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1875 [(b'e', b'engines', b'', b'compression engines to use'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1876 (b's', b'startrev', 0, b'revision to start at')],
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1877 b'-c\|-m\|FILE')
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1878 def perfrevlogchunks(ui, repo, file_=None, engines=None, startrev=0, **opts):
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1879 """Benchmark operations on revlog chunks.
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1880
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1881 Logically, each revlog is a collection of fulltext revisions. However,
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1882 stored within each revlog are "chunks" of possibly compressed data. This
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1883 data needs to be read and decompressed or compressed and written.
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1884
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1885 This command measures the time it takes to read+decompress and recompress
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1886 chunks in a revlog. It effectively isolates I/O and compression performance.
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1887 For measurements of higher-level operations like resolving revisions,
32564 7236facefd4f perf: rename perfrevlog to perfrevlogrevisions Gregory Szorc <gregory.szorc@gmail.com> parents: 32501 diff changeset	1888 see ``perfrevlogrevisions`` and ``perfrevlogrevision``.
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1889 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1890 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	1891
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1892 rl = cmdutil.openrevlog(repo, b'perfrevlogchunks', file_, opts)
32269 75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1893
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1894 # _chunkraw was renamed to _getsegmentforrevs.
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1895 try:
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1896 segmentforrevs = rl._getsegmentforrevs
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1897 except AttributeError:
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	1898 segmentforrevs = rl._chunkraw
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1899
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1900 # Verify engines argument.
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1901 if engines:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1902 engines = set(e.strip() for e in engines.split(b','))
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1903 for engine in engines:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1904 try:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1905 util.compressionengines[engine]
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1906 except KeyError:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1907 raise error.Abort(b'unknown compression engine: %s' % engine)
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1908 else:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1909 engines = []
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1910 for e in util.compengines:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1911 engine = util.compengines[e]
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1912 try:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1913 if engine.available():
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1914 engine.revlogcompressor().compress(b'dummy')
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1915 engines.append(e)
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1916 except NotImplementedError:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1917 pass
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1918
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1919 revs = list(rl.revs(startrev, len(rl) - 1))
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1920
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1921 def rlfh(rl):
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1922 if rl._inline:
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1923 return getsvfs(repo)(rl.indexfile)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1924 else:
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1925 return getsvfs(repo)(rl.datafile)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1926
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1927 def doread():
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1928 rl.clearcaches()
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1929 for rev in revs:
32268 112ba1c7d65d perf: store reference to revlog._chunkraw in a local variable Gregory Szorc <gregory.szorc@gmail.com> parents: 32265 diff changeset	1930 segmentforrevs(rev, rev)
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1931
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1932 def doreadcachedfh():
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1933 rl.clearcaches()
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1934 fh = rlfh(rl)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1935 for rev in revs:
32268 112ba1c7d65d perf: store reference to revlog._chunkraw in a local variable Gregory Szorc <gregory.szorc@gmail.com> parents: 32265 diff changeset	1936 segmentforrevs(rev, rev, df=fh)
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1937
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1938 def doreadbatch():
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1939 rl.clearcaches()
32268 112ba1c7d65d perf: store reference to revlog._chunkraw in a local variable Gregory Szorc <gregory.szorc@gmail.com> parents: 32265 diff changeset	1940 segmentforrevs(revs[0], revs[-1])
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1941
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1942 def doreadbatchcachedfh():
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1943 rl.clearcaches()
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1944 fh = rlfh(rl)
32268 112ba1c7d65d perf: store reference to revlog._chunkraw in a local variable Gregory Szorc <gregory.szorc@gmail.com> parents: 32265 diff changeset	1945 segmentforrevs(revs[0], revs[-1], df=fh)
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1946
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1947 def dochunk():
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1948 rl.clearcaches()
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1949 fh = rlfh(rl)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1950 for rev in revs:
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1951 rl._chunk(rev, df=fh)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1952
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1953 chunks = [None]
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1954
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1955 def dochunkbatch():
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1956 rl.clearcaches()
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1957 fh = rlfh(rl)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1958 # Save chunks as a side-effect.
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1959 chunks[0] = rl._chunks(revs, df=fh)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1960
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1961 def docompress(compressor):
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1962 rl.clearcaches()
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1963
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1964 try:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1965 # Swap in the requested compression engine.
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1966 oldcompressor = rl._compressor
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1967 rl._compressor = compressor
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1968 for chunk in chunks[0]:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1969 rl.compress(chunk)
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1970 finally:
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1971 rl._compressor = oldcompressor
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1972
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1973 benches = [
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1974 (lambda: doread(), b'read'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1975 (lambda: doreadcachedfh(), b'read w/ reused fd'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1976 (lambda: doreadbatch(), b'read batch'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1977 (lambda: doreadbatchcachedfh(), b'read batch w/ reused fd'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1978 (lambda: dochunk(), b'chunk'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1979 (lambda: dochunkbatch(), b'chunk batch'),
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1980 ]
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1981
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1982 for engine in sorted(engines):
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1983 compressor = util.compengines[engine].revlogcompressor()
168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1984 benches.append((functools.partial(docompress, compressor),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1985 b'compress w/ %s' % engine))
30796 168ef0a4eb3b perf: support multiple compression engines in perfrevlogchunks Gregory Szorc <gregory.szorc@gmail.com> parents: 30793 diff changeset	1986
30460 94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1987 for fn, title in benches:
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1988 timer, fm = gettimer(ui, opts)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1989 timer(fn, title=title)
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1990 fm.end()
94ca0e13d1fc perf: add command for measuring revlog chunk operations Gregory Szorc <gregory.szorc@gmail.com> parents: 30435 diff changeset	1991
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1992 @command(b'perfrevlogrevision', revlogopts + formatteropts +
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1993 [(b'', b'cache', False, b'use caches instead of clearing')],
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	1994 b'-c\|-m\|FILE REV')
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1995 def perfrevlogrevision(ui, repo, file_, rev=None, cache=None, **opts):
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1996 """Benchmark obtaining a revlog revision.
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1997
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1998 Obtaining a revlog revision consists of roughly the following steps:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	1999
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2000 1. Compute the delta chain
40581 e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2001 2. Slice the delta chain if applicable
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2002 3. Obtain the raw chunks for that delta chain
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2003 4. Decompress each raw chunk
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2004 5. Apply binary patches to obtain fulltext
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2005 6. Verify hash of fulltext
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2006
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2007 This command measures the time spent in each of these phases.
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2008 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2009 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2010
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2011 if opts.get(b'changelog') or opts.get(b'manifest'):
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2012 file_, rev = None, file_
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2013 elif rev is None:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2014 raise error.CommandError(b'perfrevlogrevision', b'invalid arguments')
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2015
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2016 r = cmdutil.openrevlog(repo, b'perfrevlogrevision', file_, opts)
32269 75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	2017
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	2018 # _chunkraw was renamed to _getsegmentforrevs.
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	2019 try:
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	2020 segmentforrevs = r._getsegmentforrevs
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	2021 except AttributeError:
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	2022 segmentforrevs = r._chunkraw
75e93d95aae6 revlog: rename _chunkraw to _getsegmentforrevs() Gregory Szorc <gregory.szorc@gmail.com> parents: 32268 diff changeset	2023
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2024 node = r.lookup(rev)
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2025 rev = r.rev(node)
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2026
30914 74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2027 def getrawchunks(data, chain):
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2028 start = r.start
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2029 length = r.length
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2030 inline = r._inline
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2031 iosize = r._io.size
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2032 buffer = util.buffer
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2033
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2034 chunks = []
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2035 ladd = chunks.append
40580 914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2036 for idx, item in enumerate(chain):
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2037 offset = start(item[0])
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2038 bits = data[idx]
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2039 for rev in item:
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2040 chunkstart = start(rev)
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2041 if inline:
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2042 chunkstart += (rev + 1) * iosize
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2043 chunklength = length(rev)
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2044 ladd(buffer(bits, chunkstart - offset, chunklength))
30914 74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2045
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2046 return chunks
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2047
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2048 def dodeltachain(rev):
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2049 if not cache:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2050 r.clearcaches()
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2051 r._deltachain(rev)
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2052
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2053 def doread(chain):
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2054 if not cache:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2055 r.clearcaches()
40580 914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2056 for item in slicedchain:
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2057 segmentforrevs(item[0], item[-1])
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2058
40581 e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2059 def doslice(r, chain, size):
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2060 for s in slicechunk(r, chain, targetsize=size):
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2061 pass
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2062
30914 74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2063 def dorawchunks(data, chain):
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2064 if not cache:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2065 r.clearcaches()
30914 74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2066 getrawchunks(data, chain)
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2067
30914 74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2068 def dodecompress(chunks):
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2069 decomp = r.decompress
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2070 for chunk in chunks:
74cfc4357c64 perf: split obtaining chunks from decompression Gregory Szorc <gregory.szorc@gmail.com> parents: 30796 diff changeset	2071 decomp(chunk)
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2072
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2073 def dopatch(text, bins):
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2074 if not cache:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2075 r.clearcaches()
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2076 mdiff.patches(text, bins)
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2077
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2078 def dohash(text):
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2079 if not cache:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2080 r.clearcaches()
30589 be5b2098a817 revlog: merge hash checking subfunctions Remi Chaintron <remi@fb.com> parents: 30460 diff changeset	2081 r.checkhash(text, node, rev=rev)
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2082
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2083 def dorevision():
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2084 if not cache:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2085 r.clearcaches()
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2086 r.revision(node)
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2087
40580 914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2088 try:
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2089 from mercurial.revlogutils.deltas import slicechunk
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2090 except ImportError:
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2091 slicechunk = getattr(revlog, '_slicechunk', None)
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2092
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2093 size = r.length(rev)
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2094 chain = r._deltachain(rev)[0]
40580 914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2095 if not getattr(r, '_withsparseread', False):
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2096 slicedchain = (chain,)
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2097 else:
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2098 slicedchain = tuple(slicechunk(r, chain, targetsize=size))
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2099 data = [segmentforrevs(seg[0], seg[-1])[1] for seg in slicedchain]
914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2100 rawchunks = getrawchunks(data, slicedchain)
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2101 bins = r._chunks(chain)
40214 b456b2e0ad9f py3: make test-contrib-perf.t work on python 3 Pulkit Goyal <pulkit@yandex-team.ru> parents: 40145 diff changeset	2102 text = bytes(bins[0])
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2103 bins = bins[1:]
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2104 text = mdiff.patches(text, bins)
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2105
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2106 benches = [
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2107 (lambda: dorevision(), b'full'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2108 (lambda: dodeltachain(rev), b'deltachain'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2109 (lambda: doread(chain), b'read'),
40581 e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2110 ]
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2111
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2112 if getattr(r, '_withsparseread', False):
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2113 slicing = (lambda: doslice(r, chain, size), b'slice-sparse-chain')
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2114 benches.append(slicing)
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2115
e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2116 benches.extend([
40580 914079ee3334 perf: teach perfrevlogrevision about sparse reading Boris Feld <boris.feld@octobus.net> parents: 40579 diff changeset	2117 (lambda: dorawchunks(data, slicedchain), b'rawchunks'),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2118 (lambda: dodecompress(rawchunks), b'decompress'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2119 (lambda: dopatch(text, bins), b'patch'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2120 (lambda: dohash(text), b'hash'),
40581 e6c8a0fd3db4 perf: measure slicing time in perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40580 diff changeset	2121 ])
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2122
40579 cf3bef7f162b perf: use the same timer for all section of perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40349 diff changeset	2123 timer, fm = gettimer(ui, opts)
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2124 for fn, title in benches:
d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2125 timer(fn, title=title)
40579 cf3bef7f162b perf: use the same timer for all section of perfrevlogrevision Boris Feld <boris.feld@octobus.net> parents: 40349 diff changeset	2126 fm.end()
27470 d394a1a3708a perf: add perfrevlogrevision Gregory Szorc <gregory.szorc@gmail.com> parents: 27467 diff changeset	2127
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2128 @command(b'perfrevset',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2129 [(b'C', b'clear', False, b'clear volatile cache between each call.'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2130 (b'', b'contexts', False, b'obtain changectx for each revision')]
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2131 + formatteropts, b"REVSET")
27072 e18a9ceade3b perf: support obtaining contexts from perfrevset Gregory Szorc <gregory.szorc@gmail.com> parents: 27017 diff changeset	2132 def perfrevset(ui, repo, expr, clear=False, contexts=False, **opts):
18239 a95f1d619bb7 perftest: add an option to invalidate volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18238 diff changeset	2133 """benchmark the execution time of a revset
a95f1d619bb7 perftest: add an option to invalidate volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18238 diff changeset	2134
18644 3e92772d5383 spelling: fix some minor issues found by spell checker Mads Kiilerich <mads@kiilerich.com> parents: 18304 diff changeset	2135 Use the --clean option if need to evaluate the impact of build volatile
18239 a95f1d619bb7 perftest: add an option to invalidate volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18238 diff changeset	2136 revisions set cache on the revset execution. Volatile cache hold filtered
a95f1d619bb7 perftest: add an option to invalidate volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18238 diff changeset	2137 and obsolete related cache."""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2138 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2139
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	2140 timer, fm = gettimer(ui, opts)
18062 1471f5e83686 perf: add a command to measure revset performance Siddharth Agarwal <sid0@fb.com> parents: 18033 diff changeset	2141 def d():
18239 a95f1d619bb7 perftest: add an option to invalidate volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18238 diff changeset	2142 if clear:
a95f1d619bb7 perftest: add an option to invalidate volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18238 diff changeset	2143 repo.invalidatevolatilesets()
27072 e18a9ceade3b perf: support obtaining contexts from perfrevset Gregory Szorc <gregory.szorc@gmail.com> parents: 27017 diff changeset	2144 if contexts:
e18a9ceade3b perf: support obtaining contexts from perfrevset Gregory Szorc <gregory.szorc@gmail.com> parents: 27017 diff changeset	2145 for ctx in repo.set(expr): pass
e18a9ceade3b perf: support obtaining contexts from perfrevset Gregory Szorc <gregory.szorc@gmail.com> parents: 27017 diff changeset	2146 else:
e18a9ceade3b perf: support obtaining contexts from perfrevset Gregory Szorc <gregory.szorc@gmail.com> parents: 27017 diff changeset	2147 for r in repo.revs(expr): pass
18062 1471f5e83686 perf: add a command to measure revset performance Siddharth Agarwal <sid0@fb.com> parents: 18033 diff changeset	2148 timer(d)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	2149 fm.end()
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2150
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2151 @command(b'perfvolatilesets',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2152 [(b'', b'clear-obsstore', False, b'drop obsstore between each call.'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2153 ] + formatteropts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	2154 def perfvolatilesets(ui, repo, names, *opts):
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2155 """benchmark the computation of various volatile set
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2156
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2157 Volatile set computes element related to filtering and obsolescence."""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2158 opts = _byteskwargs(opts)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	2159 timer, fm = gettimer(ui, opts)
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2160 repo = repo.unfiltered()
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2161
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2162 def getobs(name):
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2163 def d():
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2164 repo.invalidatevolatilesets()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2165 if opts[b'clear_obsstore']:
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2166 clearfilecache(repo, b'obsstore')
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2167 obsolete.getrevs(repo, name)
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2168 return d
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2169
18241 f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2170 allobs = sorted(obsolete.cachefuncs)
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2171 if names:
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2172 allobs = [n for n in allobs if n in names]
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2173
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2174 for name in allobs:
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2175 timer(getobs(name), title=name)
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2176
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2177 def getfiltered(name):
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2178 def d():
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2179 repo.invalidatevolatilesets()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2180 if opts[b'clear_obsstore']:
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2181 clearfilecache(repo, b'obsstore')
20205 d67a7758da6d perf: fix perfvolatilesets Pierre-Yves David <pierre-yves.david@ens-lyon.org> parents: 20178 diff changeset	2182 repoview.filterrevs(repo, name)
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2183 return d
a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2184
18241 f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2185 allfilter = sorted(repoview.filtertable)
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2186 if names:
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2187 allfilter = [n for n in allfilter if n in names]
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2188
f5ed27c51995 perftest: allow selection of volatile set to benchmark Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18240 diff changeset	2189 for name in allfilter:
18240 a8318715d8bb perftest: add a command to benchmark construction of volatile cache Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18239 diff changeset	2190 timer(getfiltered(name), title=name)
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	2191 fm.end()
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2192
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2193 @command(b'perfbranchmap',
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2194 [(b'f', b'full', False,
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2195 b'Includes build time of subset'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2196 (b'', b'clear-revbranch', False,
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2197 b'purge the revbranch cache between computation'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2198 ] + formatteropts)
36393 c25290b98190 perfbranchmap: allow to select the filter to benchmark Boris Feld <boris.feld@octobus.net> parents: 36392 diff changeset	2199 def perfbranchmap(ui, repo, filternames, *opts):
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2200 """benchmark the update of a branchmap
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2201
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2202 This benchmarks the full repo.branchmap() call with read and write disabled
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2203 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2204 opts = _byteskwargs(opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2205 full = opts.get(b"full", False)
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2206 clear_revbranch = opts.get(b"clear_revbranch", False)
25494 e8eb3ecdaa0c perf: support -T for every perf commands Pierre-Yves David <pierre-yves.david@fb.com> parents: 24607 diff changeset	2207 timer, fm = gettimer(ui, opts)
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2208 def getbranchmap(filtername):
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2209 """generate a benchmark function for the filtername"""
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2210 if filtername is None:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2211 view = repo
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2212 else:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2213 view = repo.filtered(filtername)
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2214 def d():
32730 326c0e2c1a1d perfbranchmap: add an option to purge the revbranch cache Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32565 diff changeset	2215 if clear_revbranch:
326c0e2c1a1d perfbranchmap: add an option to purge the revbranch cache Pierre-Yves David <pierre-yves.david@octobus.net> parents: 32565 diff changeset	2216 repo.revbranchcache()._clear()
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2217 if full:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2218 view._branchcaches.clear()
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2219 else:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2220 view._branchcaches.pop(filtername, None)
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2221 view.branchmap()
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2222 return d
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2223 # add filter in smaller subset to bigger subset
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2224 possiblefilters = set(repoview.filtertable)
36393 c25290b98190 perfbranchmap: allow to select the filter to benchmark Boris Feld <boris.feld@octobus.net> parents: 36392 diff changeset	2225 if filternames:
c25290b98190 perfbranchmap: allow to select the filter to benchmark Boris Feld <boris.feld@octobus.net> parents: 36392 diff changeset	2226 possiblefilters &= set(filternames)
30144 14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	2227 subsettable = getbranchmapsubsettable()
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2228 allfilters = []
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2229 while possiblefilters:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2230 for name in possiblefilters:
30144 14031d183048 perf: get subsettable from appropriate module for Mercurial earlier than 2.9 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30143 diff changeset	2231 subset = subsettable.get(name)
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2232 if subset not in possiblefilters:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2233 break
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2234 else:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2235 assert False, b'subset cycle %s!' % possiblefilters
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2236 allfilters.append(name)
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2237 possiblefilters.remove(name)
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2238
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2239 # warm the cache
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2240 if not full:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2241 for name in allfilters:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2242 repo.filtered(name).branchmap()
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2243 if not filternames or b'unfiltered' in filternames:
36393 c25290b98190 perfbranchmap: allow to select the filter to benchmark Boris Feld <boris.feld@octobus.net> parents: 36392 diff changeset	2244 # add unfiltered
c25290b98190 perfbranchmap: allow to select the filter to benchmark Boris Feld <boris.feld@octobus.net> parents: 36392 diff changeset	2245 allfilters.append(None)
30145 113aa6145020 perf: avoid actual writing branch cache out correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30144 diff changeset	2246
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2247 branchcacheread = safeattrsetter(branchmap, b'read')
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2248 branchcachewrite = safeattrsetter(branchmap.branchcache, b'write')
30145 113aa6145020 perf: avoid actual writing branch cache out correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30144 diff changeset	2249 branchcacheread.set(lambda repo: None)
113aa6145020 perf: avoid actual writing branch cache out correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30144 diff changeset	2250 branchcachewrite.set(lambda bc, repo: None)
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2251 try:
9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2252 for name in allfilters:
36392 df3f7f00a3fc perfbranchmap: display 'unfiltered' for unfiltered performance Boris Feld <boris.feld@octobus.net> parents: 36216 diff changeset	2253 printname = name
df3f7f00a3fc perfbranchmap: display 'unfiltered' for unfiltered performance Boris Feld <boris.feld@octobus.net> parents: 36216 diff changeset	2254 if name is None:
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2255 printname = b'unfiltered'
36392 df3f7f00a3fc perfbranchmap: display 'unfiltered' for unfiltered performance Boris Feld <boris.feld@octobus.net> parents: 36216 diff changeset	2256 timer(getbranchmap(name), title=str(printname))
18304 9b6ae29d4801 perf: add perfbranchmap command Pierre-Yves David <pierre-yves.david@logilab.fr> parents: 18241 diff changeset	2257 finally:
30145 113aa6145020 perf: avoid actual writing branch cache out correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30144 diff changeset	2258 branchcacheread.restore()
113aa6145020 perf: avoid actual writing branch cache out correctly FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30144 diff changeset	2259 branchcachewrite.restore()
23171 8afae1d5d108 perf: use a formatter for output Pierre-Yves David <pierre-yves.david@fb.com> parents: 22780 diff changeset	2260 fm.end()
23485 ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2261
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2262 @command(b'perfbranchmapload', [
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2263 (b'f', b'filter', b'', b'Specify repoview filter'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2264 (b'', b'list', False, b'List brachmap filter caches'),
40741 4240a1da4188 perf: add --clear-revlog flag to branchmapload Boris Feld <boris.feld@octobus.net> parents: 40740 diff changeset	2265 (b'', b'clear-revlogs', False, b'refresh changelog and manifest'),
4240a1da4188 perf: add --clear-revlog flag to branchmapload Boris Feld <boris.feld@octobus.net> parents: 40740 diff changeset	2266
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2267 ] + formatteropts)
40738 94d76ddac40a perf: update function name to match `perfbranchmapload` command Boris Feld <boris.feld@octobus.net> parents: 40737 diff changeset	2268 def perfbranchmapload(ui, repo, filter=b'', list=False, **opts):
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2269 """benchmark reading the branchmap"""
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2270 opts = _byteskwargs(opts)
40741 4240a1da4188 perf: add --clear-revlog flag to branchmapload Boris Feld <boris.feld@octobus.net> parents: 40740 diff changeset	2271 clearrevlogs = opts[b'clear_revlogs']
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2272
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2273 if list:
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2274 for name, kind, st in repo.cachevfs.readdir(stat=True):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2275 if name.startswith(b'branch2'):
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2276 filtername = name.partition(b'-')[2] or b'unfiltered'
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2277 ui.status(b'%s - %s\n'
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2278 % (filtername, util.bytecount(st.st_size)))
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2279 return
40759 0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2280 if not filter:
0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2281 filter = None
0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2282 subsettable = getbranchmapsubsettable()
0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2283 if filter is None:
0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2284 repo = repo.unfiltered()
0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2285 else:
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2286 repo = repoview.repoview(repo, filter)
40758 578646b1e2b6 perf: prewarm the branchmap in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40752 diff changeset	2287
578646b1e2b6 perf: prewarm the branchmap in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40752 diff changeset	2288 repo.branchmap() # make sure we have a relevant, up to date branchmap
578646b1e2b6 perf: prewarm the branchmap in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40752 diff changeset	2289
40759 0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2290 currentfilter = filter
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2291 # try once without timer, the filter may not be cached
40759 0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2292 while branchmap.read(repo) is None:
0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2293 currentfilter = subsettable.get(currentfilter)
0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2294 if currentfilter is None:
0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2295 raise error.Abort(b'No branchmap cached for %s repo'
0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2296 % (filter or b'unfiltered'))
0a3cc351d718 perf: fallback to subset if ondisk cache is missing in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40758 diff changeset	2297 repo = repo.filtered(currentfilter)
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2298 timer, fm = gettimer(ui, opts)
40741 4240a1da4188 perf: add --clear-revlog flag to branchmapload Boris Feld <boris.feld@octobus.net> parents: 40740 diff changeset	2299 def setup():
4240a1da4188 perf: add --clear-revlog flag to branchmapload Boris Feld <boris.feld@octobus.net> parents: 40740 diff changeset	2300 if clearrevlogs:
4240a1da4188 perf: add --clear-revlog flag to branchmapload Boris Feld <boris.feld@octobus.net> parents: 40740 diff changeset	2301 clearchangelog(repo)
40739 30f443d34a7d perf: use an explicit function in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40738 diff changeset	2302 def bench():
30f443d34a7d perf: use an explicit function in perfbranchmapload Boris Feld <boris.feld@octobus.net> parents: 40738 diff changeset	2303 branchmap.read(repo)
40741 4240a1da4188 perf: add --clear-revlog flag to branchmapload Boris Feld <boris.feld@octobus.net> parents: 40740 diff changeset	2304 timer(bench, setup=setup)
39151 222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2305 fm.end()
222aba766015 perf: time loading branchmap caches Martijn Pieters <mj@octobus.net> parents: 39015 diff changeset	2306
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2307 @command(b'perfloadmarkers')
23485 ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2308 def perfloadmarkers(ui, repo):
ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2309 """benchmark the time to parse the on-disk markers for a repo
ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2310
ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2311 Result is the number of markers in the repo."""
ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2312 timer, fm = gettimer(ui)
30146 148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	2313 svfs = getsvfs(repo)
148ccd1d9f2f perf: add functions to get vfs-like object for Mercurial earlier than 2.3 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 30145 diff changeset	2314 timer(lambda: len(obsolete.obsstore(svfs)))
23485 ccb93e9affc1 perf: add a perfloadmarkers command Pierre-Yves David <pierre-yves.david@fb.com> parents: 23171 diff changeset	2315 fm.end()
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2316
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2317 @command(b'perflrucachedict', formatteropts +
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2318 [(b'', b'costlimit', 0, b'maximum total cost of items in cache'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2319 (b'', b'mincost', 0, b'smallest cost of items in cache'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2320 (b'', b'maxcost', 100, b'maximum cost of items in cache'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2321 (b'', b'size', 4, b'size of cache'),
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2322 (b'', b'gets', 10000, b'number of key lookups'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2323 (b'', b'sets', 10000, b'number of key sets'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2324 (b'', b'mixed', 10000, b'number of mixed mode operations'),
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2325 (b'', b'mixedgetfreq', 50, b'frequency of get vs set ops in mixed mode')],
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2326 norepo=True)
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2327 def perflrucache(ui, mincost=0, maxcost=100, costlimit=0, size=4,
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2328 gets=10000, sets=10000, mixed=10000, mixedgetfreq=50, **opts):
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2329 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2330
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2331 def doinit():
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	2332 for i in _xrange(10000):
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2333 util.lrucachedict(size)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2334
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2335 costrange = list(range(mincost, maxcost + 1))
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2336
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2337 values = []
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	2338 for i in _xrange(size):
39828 c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	2339 values.append(random.randint(0, _maxint))
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2340
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2341 # Get mode fills the cache and tests raw lookup performance with no
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2342 # eviction.
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2343 getseq = []
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	2344 for i in _xrange(gets):
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2345 getseq.append(random.choice(values))
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2346
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2347 def dogets():
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2348 d = util.lrucachedict(size)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2349 for v in values:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2350 d[v] = v
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2351 for key in getseq:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2352 value = d[key]
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2353 value # silence pyflakes warning
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2354
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2355 def dogetscost():
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2356 d = util.lrucachedict(size, maxcost=costlimit)
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2357 for i, v in enumerate(values):
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2358 d.insert(v, v, cost=costs[i])
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2359 for key in getseq:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2360 try:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2361 value = d[key]
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2362 value # silence pyflakes warning
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2363 except KeyError:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2364 pass
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2365
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2366 # Set mode tests insertion speed with cache eviction.
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2367 setseq = []
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2368 costs = []
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	2369 for i in _xrange(sets):
39828 c4ab9fa81377 py3: work around the lack of sys.maxint in contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39827 diff changeset	2370 setseq.append(random.randint(0, _maxint))
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2371 costs.append(random.choice(costrange))
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2372
39583 ee087f0d7db5 util: allow lrucachedict to track cost of entries Gregory Szorc <gregory.szorc@gmail.com> parents: 39389 diff changeset	2373 def doinserts():
ee087f0d7db5 util: allow lrucachedict to track cost of entries Gregory Szorc <gregory.szorc@gmail.com> parents: 39389 diff changeset	2374 d = util.lrucachedict(size)
ee087f0d7db5 util: allow lrucachedict to track cost of entries Gregory Szorc <gregory.szorc@gmail.com> parents: 39389 diff changeset	2375 for v in setseq:
ee087f0d7db5 util: allow lrucachedict to track cost of entries Gregory Szorc <gregory.szorc@gmail.com> parents: 39389 diff changeset	2376 d.insert(v, v)
ee087f0d7db5 util: allow lrucachedict to track cost of entries Gregory Szorc <gregory.szorc@gmail.com> parents: 39389 diff changeset	2377
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2378 def doinsertscost():
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2379 d = util.lrucachedict(size, maxcost=costlimit)
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2380 for i, v in enumerate(setseq):
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2381 d.insert(v, v, cost=costs[i])
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2382
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2383 def dosets():
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2384 d = util.lrucachedict(size)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2385 for v in setseq:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2386 d[v] = v
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2387
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2388 # Mixed mode randomly performs gets and sets with eviction.
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2389 mixedops = []
39827 86dbeb7c9a11 py3: switch contrib/perf from xrange to pycompat.xrange Matt Harbison <matt_harbison@yahoo.com> parents: 39826 diff changeset	2390 for i in _xrange(mixed):
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2391 r = random.randint(0, 100)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2392 if r < mixedgetfreq:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2393 op = 0
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2394 else:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2395 op = 1
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2396
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2397 mixedops.append((op,
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2398 random.randint(0, size * 2),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2399 random.choice(costrange)))
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2400
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2401 def domixed():
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2402 d = util.lrucachedict(size)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2403
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2404 for op, v, cost in mixedops:
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2405 if op == 0:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2406 try:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2407 d[v]
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2408 except KeyError:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2409 pass
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2410 else:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2411 d[v] = v
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2412
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2413 def domixedcost():
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2414 d = util.lrucachedict(size, maxcost=costlimit)
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2415
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2416 for op, v, cost in mixedops:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2417 if op == 0:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2418 try:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2419 d[v]
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2420 except KeyError:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2421 pass
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2422 else:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2423 d.insert(v, v, cost=cost)
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2424
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2425 benches = [
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2426 (doinit, b'init'),
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2427 ]
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2428
39584 842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2429 if costlimit:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2430 benches.extend([
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2431 (dogetscost, b'gets w/ cost limit'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2432 (doinsertscost, b'inserts w/ cost limit'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2433 (domixedcost, b'mixed w/ cost limit'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2434 ])
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2435 else:
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2436 benches.extend([
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2437 (dogets, b'gets'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2438 (doinserts, b'inserts'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2439 (dosets, b'sets'),
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2440 (domixed, b'mixed')
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2441 ])
842cd0bdda75 util: teach lrucachedict to enforce a max total cost Gregory Szorc <gregory.szorc@gmail.com> parents: 39583 diff changeset	2442
27286 528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2443 for fn, title in benches:
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2444 timer, fm = gettimer(ui, opts)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2445 timer(fn, title=title)
528cf1a73ae5 perf: add perflrucachedict command Gregory Szorc <gregory.szorc@gmail.com> parents: 27100 diff changeset	2446 fm.end()
29495 f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2447
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2448 @command(b'perfwrite', formatteropts)
30997 5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2449 def perfwrite(ui, repo, **opts):
5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2450 """microbenchmark ui.write
5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2451 """
39830 874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2452 opts = _byteskwargs(opts)
874712506b07 py3: apply byteskwargs to contrib/perf Matt Harbison <matt_harbison@yahoo.com> parents: 39829 diff changeset	2453
30997 5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2454 timer, fm = gettimer(ui, opts)
5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2455 def write():
5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2456 for i in range(100000):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2457 ui.write((b'Testing write performance\n'))
30997 5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2458 timer(write)
5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2459 fm.end()
5a9e4dc8e4fd contrib: add a write microbenchmark to perf.py Simon Farnsworth <simonfar@fb.com> parents: 30995 diff changeset	2460
29495 f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2461 def uisetup(ui):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2462 if (util.safehasattr(cmdutil, b'openrevlog') and
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2463 not util.safehasattr(commands, b'debugrevlogopts')):
29495 f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2464 # for "historical portability":
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2465 # In this case, Mercurial should be 1.9 (or a79fea6b3e77) -
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2466 # 3.7 (or 5606f7d0d063). Therefore, '--dir' option for
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2467 # openrevlog() should cause failure, because it has been
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2468 # available since 3.5 (or 49c583ca48c4).
f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2469 def openrevlog(orig, repo, cmd, file_, opts):
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2470 if opts.get(b'dir') and not util.safehasattr(repo, b'dirlog'):
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2471 raise error.Abort(b"This version doesn't support --dir option",
438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2472 hint=b"use 3.5 or later")
29495 f83445296213 perf: use locally defined revlog option list for Mercurial earlier than 3.7 FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 29494 diff changeset	2473 return orig(repo, cmd, file_, opts)
39389 438f3932a432 contrib: byteify perf.py file Pulkit Goyal <pulkit@yandex-team.ru> parents: 39346 diff changeset	2474 extensions.wrapfunction(cmdutil, b'openrevlog', openrevlog)

Mercurial > public > mercurial-scm > hg-stable

annotate contrib/perf.py @ 40778:594e84a2e574