mercurial-scm/hg-stable: mercurial/statprof.py annotate

annotate mercurial/statprof.py @ 43076:2372284d9457

formatting: blacken the codebase This is using my patch to black (https://github.com/psf/black/pull/826) so we don't un-wrap collection literals. Done with: hg files 'set:**.py - mercurial/thirdparty/** - "contrib/python-zstandard/**"' | xargs black -S # skip-blame mass-reformatting only # no-check-commit reformats foo_bar functions Differential Revision: https://phab.mercurial-scm.org/D6971

author	Augie Fackler <augie@google.com>
date	Sun, 06 Oct 2019 09:45:02 -0400
parents	9a3be115fb78
children	687b865b95ad

rev	line source
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1 ## statprof.py
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	2 ## Copyright (C) 2012 Bryan O'Sullivan <bos@serpentine.com>
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	3 ## Copyright (C) 2011 Alex Fraser <alex at phatcore dot com>
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	4 ## Copyright (C) 2004,2005 Andy Wingo <wingo at pobox dot com>
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	5 ## Copyright (C) 2001 Rob Browning <rlb at defaultvalue dot org>
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	6
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	7 ## This library is free software; you can redistribute it and/or
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	8 ## modify it under the terms of the GNU Lesser General Public
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	9 ## License as published by the Free Software Foundation; either
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	10 ## version 2.1 of the License, or (at your option) any later version.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	11 ##
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	12 ## This library is distributed in the hope that it will be useful,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	13 ## but WITHOUT ANY WARRANTY; without even the implied warranty of
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	14 ## MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	15 ## Lesser General Public License for more details.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	16 ##
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	17 ## You should have received a copy of the GNU Lesser General Public
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	18 ## License along with this program; if not, contact:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	19 ##
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	20 ## Free Software Foundation Voice: +1-617-542-5942
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	21 ## 59 Temple Place - Suite 330 Fax: +1-617-542-2652
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	22 ## Boston, MA 02111-1307, USA gnu@gnu.org
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	23
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	24 """
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	25 statprof is intended to be a fairly simple statistical profiler for
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	26 python. It was ported directly from a statistical profiler for guile,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	27 also named statprof, available from guile-lib [0].
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	28
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	29 [0] http://wingolog.org/software/guile-lib/statprof/
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	30
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	31 To start profiling, call statprof.start():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	32 >>> start()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	33
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	34 Then run whatever it is that you want to profile, for example:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	35 >>> import test.pystone; test.pystone.pystones()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	36
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	37 Then stop the profiling and print out the results:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	38 >>> stop()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	39 >>> display()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	40 % cumulative self
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	41 time seconds seconds name
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	42 26.72 1.40 0.37 pystone.py:79:Proc0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	43 13.79 0.56 0.19 pystone.py:133:Proc1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	44 13.79 0.19 0.19 pystone.py:208:Proc8
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	45 10.34 0.16 0.14 pystone.py:229:Func2
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	46 6.90 0.10 0.10 pystone.py:45:__init__
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	47 4.31 0.16 0.06 pystone.py:53:copy
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	48 ...
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	49
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	50 All of the numerical data is statistically approximate. In the
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	51 following column descriptions, and in all of statprof, "time" refers
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	52 to execution time (both user and system), not wall clock time.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	53
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	54 % time
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	55 The percent of the time spent inside the procedure itself (not
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	56 counting children).
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	57
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	58 cumulative seconds
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	59 The total number of seconds spent in the procedure, including
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	60 children.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	61
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	62 self seconds
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	63 The total number of seconds spent in the procedure itself (not
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	64 counting children).
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	65
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	66 name
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	67 The name of the procedure.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	68
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	69 By default statprof keeps the data collected from previous runs. If you
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	70 want to clear the collected data, call reset():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	71 >>> reset()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	72
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	73 reset() can also be used to change the sampling frequency from the
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	74 default of 1000 Hz. For example, to tell statprof to sample 50 times a
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	75 second:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	76 >>> reset(50)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	77
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	78 This means that statprof will sample the call stack after every 1/50 of
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	79 a second of user + system time spent running on behalf of the python
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	80 process. When your process is idle (for example, blocking in a read(),
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	81 as is the case at the listener), the clock does not advance. For this
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	82 reason statprof is not currently not suitable for profiling io-bound
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	83 operations.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	84
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	85 The profiler uses the hash of the code object itself to identify the
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	86 procedures, so it won't confuse different procedures with the same name.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	87 They will show up as two different rows in the output.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	88
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	89 Right now the profiler is quite simplistic. I cannot provide
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	90 call-graphs or other higher level information. What you see in the
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	91 table is pretty much all there is. Patches are welcome :-)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	92
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	93
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	94 Threading
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	95 ---------
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	96
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	97 Because signals only get delivered to the main thread in Python,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	98 statprof only profiles the main thread. However because the time
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	99 reporting function uses per-process timers, the results can be
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	100 significantly off if other threads' work patterns are not similar to the
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	101 main thread's work patterns.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	102 """
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	103 # no-check-code
30271 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30270 diff changeset	104 from __future__ import absolute_import, division, print_function
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	105
30270 2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30269 diff changeset	106 import collections
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30269 diff changeset	107 import contextlib
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30269 diff changeset	108 import getopt
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30269 diff changeset	109 import inspect
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30269 diff changeset	110 import json
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30269 diff changeset	111 import os
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30269 diff changeset	112 import signal
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30269 diff changeset	113 import sys
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30269 diff changeset	114 import threading
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	115 import time
30270 2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30269 diff changeset	116
30583 c6ce11f2ee50 py3: make a bytes version of getopt.getopt() Pulkit Goyal <7895pulkit@gmail.com> parents: 30573 diff changeset	117 from . import (
30642 344e68882cd3 py3: replace os.environ with encoding.environ (part 4 of 5) Pulkit Goyal <7895pulkit@gmail.com> parents: 30583 diff changeset	118 encoding,
30583 c6ce11f2ee50 py3: make a bytes version of getopt.getopt() Pulkit Goyal <7895pulkit@gmail.com> parents: 30573 diff changeset	119 pycompat,
c6ce11f2ee50 py3: make a bytes version of getopt.getopt() Pulkit Goyal <7895pulkit@gmail.com> parents: 30573 diff changeset	120 )
c6ce11f2ee50 py3: make a bytes version of getopt.getopt() Pulkit Goyal <7895pulkit@gmail.com> parents: 30573 diff changeset	121
30270 2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30269 diff changeset	122 defaultdict = collections.defaultdict
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30269 diff changeset	123 contextmanager = contextlib.contextmanager
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	124
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	125 __all__ = ['start', 'stop', 'reset', 'display', 'profile']
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	126
40196 2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	127 skips = {
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	128 r"util.py:check",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	129 r"extensions.py:closure",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	130 r"color.py:colorcmd",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	131 r"dispatch.py:checkargs",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	132 r"dispatch.py:<lambda>",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	133 r"dispatch.py:_runcatch",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	134 r"dispatch.py:_dispatch",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	135 r"dispatch.py:_runcommand",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	136 r"pager.py:pagecmd",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	137 r"dispatch.py:run",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	138 r"dispatch.py:dispatch",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	139 r"dispatch.py:runcommand",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	140 r"hg.py:<module>",
2864f8d3fcd6 py3: use raw strings for stack names Gregory Szorc <gregory.szorc@gmail.com> parents: 40191 diff changeset	141 r"evolve.py:warnobserrors",
32331 bd872f64a8ba cleanup: use set literals Martin von Zweigbergk <martinvonz@google.com> parents: 31091 diff changeset	142 }
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	143
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	144 ###########################################################################
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	145 ## Utils
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	146
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	147
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	148 def clock():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	149 times = os.times()
38271 af402c6b90db statprof: also gather wall time Boris Feld <boris.feld@octobus.net> parents: 38197 diff changeset	150 return (times[0] + times[1], times[4])
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	151
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	152
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	153 ###########################################################################
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	154 ## Collection data structures
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	155
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	156
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	157 class ProfileState(object):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	158 def __init__(self, frequency=None):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	159 self.reset(frequency)
38272 15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	160 self.track = 'cpu'
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	161
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	162 def reset(self, frequency=None):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	163 # total so far
38271 af402c6b90db statprof: also gather wall time Boris Feld <boris.feld@octobus.net> parents: 38197 diff changeset	164 self.accumulated_time = (0.0, 0.0)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	165 # start_time when timer is active
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	166 self.last_start_time = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	167 # a float
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	168 if frequency:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	169 self.sample_interval = 1.0 / frequency
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	170 elif not hasattr(self, 'sample_interval'):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	171 # default to 1000 Hz
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	172 self.sample_interval = 1.0 / 1000.0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	173 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	174 # leave the frequency as it was
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	175 pass
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	176 self.remaining_prof_time = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	177 # for user start/stop nesting
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	178 self.profile_level = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	179
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	180 self.samples = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	181
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	182 def accumulate_time(self, stop_time):
38271 af402c6b90db statprof: also gather wall time Boris Feld <boris.feld@octobus.net> parents: 38197 diff changeset	183 increment = (
af402c6b90db statprof: also gather wall time Boris Feld <boris.feld@octobus.net> parents: 38197 diff changeset	184 stop_time[0] - self.last_start_time[0],
af402c6b90db statprof: also gather wall time Boris Feld <boris.feld@octobus.net> parents: 38197 diff changeset	185 stop_time[1] - self.last_start_time[1],
af402c6b90db statprof: also gather wall time Boris Feld <boris.feld@octobus.net> parents: 38197 diff changeset	186 )
af402c6b90db statprof: also gather wall time Boris Feld <boris.feld@octobus.net> parents: 38197 diff changeset	187 self.accumulated_time = (
af402c6b90db statprof: also gather wall time Boris Feld <boris.feld@octobus.net> parents: 38197 diff changeset	188 self.accumulated_time[0] + increment[0],
af402c6b90db statprof: also gather wall time Boris Feld <boris.feld@octobus.net> parents: 38197 diff changeset	189 self.accumulated_time[1] + increment[1],
af402c6b90db statprof: also gather wall time Boris Feld <boris.feld@octobus.net> parents: 38197 diff changeset	190 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	191
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	192 def seconds_per_sample(self):
38272 15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	193 return self.accumulated_time[self.timeidx] / len(self.samples)
15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	194
15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	195 @property
15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	196 def timeidx(self):
15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	197 if self.track == 'real':
15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	198 return 1
15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	199 return 0
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	200
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	201
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	202 state = ProfileState()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	203
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	204
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	205 class CodeSite(object):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	206 cache = {}
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	207
41836 ae189674bdad global: use raw strings for __slots__ Gregory Szorc <gregory.szorc@gmail.com> parents: 41387 diff changeset	208 __slots__ = (r'path', r'lineno', r'function', r'source')
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	209
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	210 def __init__(self, path, lineno, function):
40534 93501a5fd62b statprof: add a couple of asserts to avoid storing unicodes Augie Fackler <augie@google.com> parents: 40385 diff changeset	211 assert isinstance(path, bytes)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	212 self.path = path
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	213 self.lineno = lineno
40534 93501a5fd62b statprof: add a couple of asserts to avoid storing unicodes Augie Fackler <augie@google.com> parents: 40385 diff changeset	214 assert isinstance(function, bytes)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	215 self.function = function
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	216 self.source = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	217
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	218 def __eq__(self, other):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	219 try:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	220 return self.lineno == other.lineno and self.path == other.path
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	221 except:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	222 return False
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	223
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	224 def __hash__(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	225 return hash((self.lineno, self.path))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	226
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	227 @classmethod
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	228 def get(cls, path, lineno, function):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	229 k = (path, lineno)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	230 try:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	231 return cls.cache[k]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	232 except KeyError:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	233 v = cls(path, lineno, function)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	234 cls.cache[k] = v
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	235 return v
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	236
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	237 def getsource(self, length):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	238 if self.source is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	239 lineno = self.lineno - 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	240 try:
42844 c085cb134b9e statprof: use context manager when reading source from file Martin von Zweigbergk <martinvonz@google.com> parents: 42843 diff changeset	241 with open(self.path, 'rb') as fp:
c085cb134b9e statprof: use context manager when reading source from file Martin von Zweigbergk <martinvonz@google.com> parents: 42843 diff changeset	242 for i, line in enumerate(fp):
c085cb134b9e statprof: use context manager when reading source from file Martin von Zweigbergk <martinvonz@google.com> parents: 42843 diff changeset	243 if i == lineno:
c085cb134b9e statprof: use context manager when reading source from file Martin von Zweigbergk <martinvonz@google.com> parents: 42843 diff changeset	244 self.source = line.strip()
c085cb134b9e statprof: use context manager when reading source from file Martin von Zweigbergk <martinvonz@google.com> parents: 42843 diff changeset	245 break
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	246 except:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	247 pass
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	248 if self.source is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	249 self.source = ''
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	250
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	251 source = self.source
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	252 if len(source) > length:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	253 source = source[: (length - 3)] + "..."
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	254 return source
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	255
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	256 def filename(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	257 return os.path.basename(self.path)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	258
40385 cc4586749c8c statprof: fix overflow while skipping boilerplate parts Yuya Nishihara <yuya@tcha.org> parents: 40384 diff changeset	259 def skipname(self):
cc4586749c8c statprof: fix overflow while skipping boilerplate parts Yuya Nishihara <yuya@tcha.org> parents: 40384 diff changeset	260 return r'%s:%s' % (self.filename(), self.function)
cc4586749c8c statprof: fix overflow while skipping boilerplate parts Yuya Nishihara <yuya@tcha.org> parents: 40384 diff changeset	261
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	262
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	263 class Sample(object):
41836 ae189674bdad global: use raw strings for __slots__ Gregory Szorc <gregory.szorc@gmail.com> parents: 41387 diff changeset	264 __slots__ = (r'stack', r'time')
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	265
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	266 def __init__(self, stack, time):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	267 self.stack = stack
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	268 self.time = time
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	269
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	270 @classmethod
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	271 def from_frame(cls, frame, time):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	272 stack = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	273
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	274 while frame:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	275 stack.append(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	276 CodeSite.get(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	277 pycompat.sysbytes(frame.f_code.co_filename),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	278 frame.f_lineno,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	279 pycompat.sysbytes(frame.f_code.co_name),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	280 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	281 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	282 frame = frame.f_back
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	283
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	284 return Sample(stack, time)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	285
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	286
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	287 ###########################################################################
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	288 ## SIGPROF handler
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	289
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	290
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	291 def profile_signal_handler(signum, frame):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	292 if state.profile_level > 0:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	293 now = clock()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	294 state.accumulate_time(now)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	295
38272 15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	296 timestamp = state.accumulated_time[state.timeidx]
15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	297 state.samples.append(Sample.from_frame(frame, timestamp))
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	298
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	299 signal.setitimer(signal.ITIMER_PROF, state.sample_interval, 0.0)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	300 state.last_start_time = now
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	301
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	302
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	303 stopthread = threading.Event()
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	304
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	305
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	306 def samplerthread(tid):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	307 while not stopthread.is_set():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	308 now = clock()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	309 state.accumulate_time(now)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	310
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	311 frame = sys._current_frames()[tid]
38272 15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	312
15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	313 timestamp = state.accumulated_time[state.timeidx]
15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	314 state.samples.append(Sample.from_frame(frame, timestamp))
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	315
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	316 state.last_start_time = now
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	317 time.sleep(state.sample_interval)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	318
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	319 stopthread.clear()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	320
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	321
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	322 ###########################################################################
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	323 ## Profiling API
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	324
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	325
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	326 def is_active():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	327 return state.profile_level > 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	328
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	329
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	330 lastmechanism = None
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	331
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	332
38272 15a1e37f80bd profiling: introduce a "profiling.time-track" option Boris Feld <boris.feld@octobus.net> parents: 38271 diff changeset	333 def start(mechanism='thread', track='cpu'):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	334 '''Install the profiling signal handler, and start profiling.'''
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	335 state.track = track # note: nesting different mode won't work
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	336 state.profile_level += 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	337 if state.profile_level == 1:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	338 state.last_start_time = clock()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	339 rpt = state.remaining_prof_time
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	340 state.remaining_prof_time = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	341
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	342 global lastmechanism
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	343 lastmechanism = mechanism
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	344
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	345 if mechanism == 'signal':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	346 signal.signal(signal.SIGPROF, profile_signal_handler)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	347 signal.setitimer(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	348 signal.ITIMER_PROF, rpt or state.sample_interval, 0.0
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	349 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	350 elif mechanism == 'thread':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	351 frame = inspect.currentframe()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	352 tid = [k for k, f in sys._current_frames().items() if f == frame][0]
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	353 state.thread = threading.Thread(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	354 target=samplerthread, args=(tid,), name="samplerthread"
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	355 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	356 state.thread.start()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	357
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	358
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	359 def stop():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	360 '''Stop profiling, and uninstall the profiling signal handler.'''
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	361 state.profile_level -= 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	362 if state.profile_level == 0:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	363 if lastmechanism == 'signal':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	364 rpt = signal.setitimer(signal.ITIMER_PROF, 0.0, 0.0)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	365 signal.signal(signal.SIGPROF, signal.SIG_IGN)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	366 state.remaining_prof_time = rpt[0]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	367 elif lastmechanism == 'thread':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	368 stopthread.set()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	369 state.thread.join()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	370
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	371 state.accumulate_time(clock())
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	372 state.last_start_time = None
30642 344e68882cd3 py3: replace os.environ with encoding.environ (part 4 of 5) Pulkit Goyal <7895pulkit@gmail.com> parents: 30583 diff changeset	373 statprofpath = encoding.environ.get('STATPROF_DEST')
30269 f42cd5434cc2 statprof: require paths to save or load profile data Gregory Szorc <gregory.szorc@gmail.com> parents: 30268 diff changeset	374 if statprofpath:
f42cd5434cc2 statprof: require paths to save or load profile data Gregory Szorc <gregory.szorc@gmail.com> parents: 30268 diff changeset	375 save_data(statprofpath)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	376
30312 1e5346313963 statprof: return state from stop() Gregory Szorc <gregory.szorc@gmail.com> parents: 30272 diff changeset	377 return state
1e5346313963 statprof: return state from stop() Gregory Szorc <gregory.szorc@gmail.com> parents: 30272 diff changeset	378
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	379
30269 f42cd5434cc2 statprof: require paths to save or load profile data Gregory Szorc <gregory.szorc@gmail.com> parents: 30268 diff changeset	380 def save_data(path):
f42cd5434cc2 statprof: require paths to save or load profile data Gregory Szorc <gregory.szorc@gmail.com> parents: 30268 diff changeset	381 with open(path, 'w+') as file:
38286 99188a7c8717 statprof: fix save and load Boris Feld <boris.feld@octobus.net> parents: 38272 diff changeset	382 file.write("%f %f\n" % state.accumulated_time)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	383 for sample in state.samples:
40197 113adb1b3f24 py3: use %d in a few places Gregory Szorc <gregory.szorc@gmail.com> parents: 40196 diff changeset	384 time = sample.time
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	385 stack = sample.stack
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	386 sites = [
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	387 '\1'.join([s.path, b'%d' % s.lineno, s.function]) for s in stack
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	388 ]
40197 113adb1b3f24 py3: use %d in a few places Gregory Szorc <gregory.szorc@gmail.com> parents: 40196 diff changeset	389 file.write("%d\0%s\n" % (time, '\0'.join(sites)))
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	390
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	391
30269 f42cd5434cc2 statprof: require paths to save or load profile data Gregory Szorc <gregory.szorc@gmail.com> parents: 30268 diff changeset	392 def load_data(path):
40535 8664fdc1cfb3 statprof: clean up unicode/bytes a little Augie Fackler <augie@google.com> parents: 40534 diff changeset	393 lines = open(path, 'rb').read().splitlines()
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	394
38286 99188a7c8717 statprof: fix save and load Boris Feld <boris.feld@octobus.net> parents: 38272 diff changeset	395 state.accumulated_time = [float(value) for value in lines[0].split()]
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	396 state.samples = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	397 for line in lines[1:]:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	398 parts = line.split('\0')
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	399 time = float(parts[0])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	400 rawsites = parts[1:]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	401 sites = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	402 for rawsite in rawsites:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	403 siteparts = rawsite.split('\1')
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	404 sites.append(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	405 CodeSite.get(siteparts[0], int(siteparts[1]), siteparts[2])
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	406 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	407
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	408 state.samples.append(Sample(sites, time))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	409
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	410
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	411 def reset(frequency=None):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	412 '''Clear out the state of the profiler. Do not call while the
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	413 profiler is running.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	414
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	415 The optional frequency argument specifies the number of samples to
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	416 collect per second.'''
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	417 assert state.profile_level == 0, "Can't reset() while statprof is running"
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	418 CodeSite.cache.clear()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	419 state.reset(frequency)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	420
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	421
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	422 @contextmanager
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	423 def profile():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	424 start()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	425 try:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	426 yield
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	427 finally:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	428 stop()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	429 display()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	430
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	431
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	432 ###########################################################################
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	433 ## Reporting API
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	434
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	435
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	436 class SiteStats(object):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	437 def __init__(self, site):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	438 self.site = site
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	439 self.selfcount = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	440 self.totalcount = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	441
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	442 def addself(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	443 self.selfcount += 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	444
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	445 def addtotal(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	446 self.totalcount += 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	447
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	448 def selfpercent(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	449 return self.selfcount / len(state.samples) * 100
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	450
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	451 def totalpercent(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	452 return self.totalcount / len(state.samples) * 100
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	453
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	454 def selfseconds(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	455 return self.selfcount * state.seconds_per_sample()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	456
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	457 def totalseconds(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	458 return self.totalcount * state.seconds_per_sample()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	459
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	460 @classmethod
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	461 def buildstats(cls, samples):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	462 stats = {}
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	463
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	464 for sample in samples:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	465 for i, site in enumerate(sample.stack):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	466 sitestat = stats.get(site)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	467 if not sitestat:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	468 sitestat = SiteStats(site)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	469 stats[site] = sitestat
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	470
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	471 sitestat.addtotal()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	472
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	473 if i == 0:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	474 sitestat.addself()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	475
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	476 return [s for s in stats.itervalues()]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	477
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	478
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	479 class DisplayFormats:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	480 ByLine = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	481 ByMethod = 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	482 AboutMethod = 2
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	483 Hotpath = 3
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	484 FlameGraph = 4
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	485 Json = 5
30949 cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	486 Chrome = 6
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	487
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	488
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	489 def display(fp=None, format=3, data=None, **kwargs):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	490 '''Print statistics, either to stdout or the given file object.'''
38697 3c569172848d statprof: small if cleanup Boris Feld <boris.feld@octobus.net> parents: 38286 diff changeset	491 if data is None:
3c569172848d statprof: small if cleanup Boris Feld <boris.feld@octobus.net> parents: 38286 diff changeset	492 data = state
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	493
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	494 if fp is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	495 import sys
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	496
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	497 fp = sys.stdout
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	498 if len(data.samples) == 0:
40198 9d3034348c4f py3: switch from print(..., file=) to write() Gregory Szorc <gregory.szorc@gmail.com> parents: 40197 diff changeset	499 fp.write(b'No samples recorded.\n')
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	500 return
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	501
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	502 if format == DisplayFormats.ByLine:
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	503 display_by_line(data, fp)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	504 elif format == DisplayFormats.ByMethod:
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	505 display_by_method(data, fp)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	506 elif format == DisplayFormats.AboutMethod:
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	507 display_about_method(data, fp, **kwargs)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	508 elif format == DisplayFormats.Hotpath:
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	509 display_hotpath(data, fp, **kwargs)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	510 elif format == DisplayFormats.FlameGraph:
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	511 write_to_flame(data, fp, **kwargs)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	512 elif format == DisplayFormats.Json:
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	513 write_to_json(data, fp)
30949 cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	514 elif format == DisplayFormats.Chrome:
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	515 write_to_chrome(data, fp, **kwargs)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	516 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	517 raise Exception("Invalid display format")
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	518
30949 cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	519 if format not in (DisplayFormats.Json, DisplayFormats.Chrome):
40198 9d3034348c4f py3: switch from print(..., file=) to write() Gregory Szorc <gregory.szorc@gmail.com> parents: 40197 diff changeset	520 fp.write(b'---\n')
9d3034348c4f py3: switch from print(..., file=) to write() Gregory Szorc <gregory.szorc@gmail.com> parents: 40197 diff changeset	521 fp.write(b'Sample count: %d\n' % len(data.samples))
9d3034348c4f py3: switch from print(..., file=) to write() Gregory Szorc <gregory.szorc@gmail.com> parents: 40197 diff changeset	522 fp.write(b'Total time: %f seconds (%f wall)\n' % data.accumulated_time)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	523
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	524
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	525 def display_by_line(data, fp):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	526 '''Print the profiler data with each sample line represented
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	527 as one row in a table. Sorted by self-time per line.'''
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	528 stats = SiteStats.buildstats(data.samples)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	529 stats.sort(reverse=True, key=lambda x: x.selfseconds())
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	530
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	531 fp.write(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	532 b'%5.5s %10.10s %7.7s %-8.8s\n'
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	533 % (b'% ', b'cumulative', b'self', b'')
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	534 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	535 fp.write(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	536 b'%5.5s %9.9s %8.8s %-8.8s\n'
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	537 % (b"time", b"seconds", b"seconds", b"name")
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	538 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	539
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	540 for stat in stats:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	541 site = stat.site
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	542 sitelabel = '%s:%d:%s' % (site.filename(), site.lineno, site.function)
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	543 fp.write(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	544 b'%6.2f %9.2f %9.2f %s\n'
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	545 % (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	546 stat.selfpercent(),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	547 stat.totalseconds(),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	548 stat.selfseconds(),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	549 sitelabel,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	550 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	551 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	552
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	553
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	554 def display_by_method(data, fp):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	555 '''Print the profiler data with each sample function represented
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	556 as one row in a table. Important lines within that function are
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	557 output as nested rows. Sorted by self-time per line.'''
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	558 fp.write(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	559 b'%5.5s %10.10s %7.7s %-8.8s\n' % ('% ', 'cumulative', 'self', '')
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	560 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	561 fp.write(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	562 b'%5.5s %9.9s %8.8s %-8.8s\n'
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	563 % ("time", "seconds", "seconds", "name")
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	564 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	565
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	566 stats = SiteStats.buildstats(data.samples)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	567
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	568 grouped = defaultdict(list)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	569 for stat in stats:
40535 8664fdc1cfb3 statprof: clean up unicode/bytes a little Augie Fackler <augie@google.com> parents: 40534 diff changeset	570 grouped[stat.site.filename() + b":" + stat.site.function].append(stat)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	571
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	572 # compute sums for each function
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	573 functiondata = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	574 for fname, sitestats in grouped.iteritems():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	575 total_cum_sec = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	576 total_self_sec = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	577 total_percent = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	578 for stat in sitestats:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	579 total_cum_sec += stat.totalseconds()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	580 total_self_sec += stat.selfseconds()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	581 total_percent += stat.selfpercent()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	582
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	583 functiondata.append(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	584 (fname, total_cum_sec, total_self_sec, total_percent, sitestats)
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	585 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	586
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	587 # sort by total self sec
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	588 functiondata.sort(reverse=True, key=lambda x: x[2])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	589
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	590 for function in functiondata:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	591 if function[3] < 0.05:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	592 continue
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	593 fp.write(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	594 b'%6.2f %9.2f %9.2f %s\n'
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	595 % (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	596 function[3], # total percent
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	597 function[1], # total cum sec
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	598 function[2], # total self sec
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	599 function[0],
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	600 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	601 ) # file:function
40198 9d3034348c4f py3: switch from print(..., file=) to write() Gregory Szorc <gregory.szorc@gmail.com> parents: 40197 diff changeset	602
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	603 function[4].sort(reverse=True, key=lambda i: i.selfseconds())
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	604 for stat in function[4]:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	605 # only show line numbers for significant locations (>1% time spent)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	606 if stat.selfpercent() > 1:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	607 source = stat.site.getsource(25)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	608 if sys.version_info.major >= 3 and not isinstance(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	609 source, bytes
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	610 ):
40201 7df42042636d py3: sprinkle statprof.py with utf-8 encoding Gregory Szorc <gregory.szorc@gmail.com> parents: 40199 diff changeset	611 source = pycompat.bytestr(source)
7df42042636d py3: sprinkle statprof.py with utf-8 encoding Gregory Szorc <gregory.szorc@gmail.com> parents: 40199 diff changeset	612
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	613 stattuple = (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	614 stat.selfpercent(),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	615 stat.selfseconds(),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	616 stat.site.lineno,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	617 source,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	618 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	619
40198 9d3034348c4f py3: switch from print(..., file=) to write() Gregory Szorc <gregory.szorc@gmail.com> parents: 40197 diff changeset	620 fp.write(b'%33.0f%% %6.2f line %d: %s\n' % stattuple)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	621
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	622
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	623 def display_about_method(data, fp, function=None, **kwargs):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	624 if function is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	625 raise Exception("Invalid function")
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	626
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	627 filename = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	628 if ':' in function:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	629 filename, function = function.split(':')
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	630
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	631 relevant_samples = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	632 parents = {}
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	633 children = {}
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	634
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	635 for sample in data.samples:
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	636 for i, site in enumerate(sample.stack):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	637 if site.function == function and (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	638 not filename or site.filename() == filename
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	639 ):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	640 relevant_samples += 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	641 if i != len(sample.stack) - 1:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	642 parent = sample.stack[i + 1]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	643 if parent in parents:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	644 parents[parent] = parents[parent] + 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	645 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	646 parents[parent] = 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	647
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	648 if site in children:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	649 children[site] = children[site] + 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	650 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	651 children[site] = 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	652
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	653 parents = [(parent, count) for parent, count in parents.iteritems()]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	654 parents.sort(reverse=True, key=lambda x: x[1])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	655 for parent, count in parents:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	656 fp.write(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	657 b'%6.2f%% %s:%s line %s: %s\n'
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	658 % (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	659 count / relevant_samples * 100,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	660 pycompat.fsencode(parent.filename()),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	661 pycompat.sysbytes(parent.function),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	662 parent.lineno,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	663 pycompat.sysbytes(parent.getsource(50)),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	664 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	665 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	666
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	667 stats = SiteStats.buildstats(data.samples)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	668 stats = [
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	669 s
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	670 for s in stats
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	671 if s.site.function == function
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	672 and (not filename or s.site.filename() == filename)
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	673 ]
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	674
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	675 total_cum_sec = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	676 total_self_sec = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	677 total_self_percent = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	678 total_cum_percent = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	679 for stat in stats:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	680 total_cum_sec += stat.totalseconds()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	681 total_self_sec += stat.selfseconds()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	682 total_self_percent += stat.selfpercent()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	683 total_cum_percent += stat.totalpercent()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	684
40198 9d3034348c4f py3: switch from print(..., file=) to write() Gregory Szorc <gregory.szorc@gmail.com> parents: 40197 diff changeset	685 fp.write(
9d3034348c4f py3: switch from print(..., file=) to write() Gregory Szorc <gregory.szorc@gmail.com> parents: 40197 diff changeset	686 b'\n %s:%s Total: %0.2fs (%0.2f%%) Self: %0.2fs (%0.2f%%)\n\n'
9d3034348c4f py3: switch from print(..., file=) to write() Gregory Szorc <gregory.szorc@gmail.com> parents: 40197 diff changeset	687 % (
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	688 pycompat.sysbytes(filename or '___'),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	689 pycompat.sysbytes(function),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	690 total_cum_sec,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	691 total_cum_percent,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	692 total_self_sec,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	693 total_self_percent,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	694 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	695 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	696
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	697 children = [(child, count) for child, count in children.iteritems()]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	698 children.sort(reverse=True, key=lambda x: x[1])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	699 for child, count in children:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	700 fp.write(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	701 b' %6.2f%% line %s: %s\n'
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	702 % (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	703 count / relevant_samples * 100,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	704 child.lineno,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	705 pycompat.sysbytes(child.getsource(50)),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	706 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	707 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	708
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	709
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	710 def display_hotpath(data, fp, limit=0.05, **kwargs):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	711 class HotNode(object):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	712 def __init__(self, site):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	713 self.site = site
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	714 self.count = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	715 self.children = {}
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	716
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	717 def add(self, stack, time):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	718 self.count += time
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	719 site = stack[0]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	720 child = self.children.get(site)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	721 if not child:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	722 child = HotNode(site)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	723 self.children[site] = child
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	724
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	725 if len(stack) > 1:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	726 i = 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	727 # Skip boiler plate parts of the stack
40385 cc4586749c8c statprof: fix overflow while skipping boilerplate parts Yuya Nishihara <yuya@tcha.org> parents: 40384 diff changeset	728 while i < len(stack) and stack[i].skipname() in skips:
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	729 i += 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	730 if i < len(stack):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	731 child.add(stack[i:], time)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	732
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	733 root = HotNode(None)
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	734 lasttime = data.samples[0].time
eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	735 for sample in data.samples:
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	736 root.add(sample.stack[::-1], sample.time - lasttime)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	737 lasttime = sample.time
42439 0ae593e791fb profiling: show actual time spent in hotpath display Valentin Gatien-Baron <vgatien-baron@janestreet.com> parents: 41836 diff changeset	738 showtime = kwargs.get(r'showtime', True)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	739
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	740 def _write(node, depth, multiple_siblings):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	741 site = node.site
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	742 visiblechildren = [
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	743 c
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	744 for c in node.children.itervalues()
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	745 if c.count >= (limit * root.count)
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	746 ]
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	747 if site:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	748 indent = depth * 2 - 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	749 filename = ''
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	750 function = ''
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	751 if len(node.children) > 0:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	752 childsite = list(node.children.itervalues())[0].site
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	753 filename = (childsite.filename() + ':').ljust(15)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	754 function = childsite.function
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	755
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	756 # lots of string formatting
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	757 listpattern = (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	758 ''.ljust(indent)
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	759 + ('\\' if multiple_siblings else '\|')
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	760 + ' %4.1f%%'
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	761 + (' %5.2fs' % node.count if showtime else '')
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	762 + ' %s %s'
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	763 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	764 liststring = listpattern % (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	765 node.count / root.count * 100,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	766 filename,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	767 function,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	768 )
40535 8664fdc1cfb3 statprof: clean up unicode/bytes a little Augie Fackler <augie@google.com> parents: 40534 diff changeset	769 codepattern = '%' + ('%d' % (55 - len(liststring))) + 's %d: %s'
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	770 codestring = codepattern % ('line', site.lineno, site.getsource(30))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	771
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	772 finalstring = liststring + codestring
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	773 childrensamples = sum([c.count for c in node.children.itervalues()])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	774 # Make frames that performed more than 10% of the operation red
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	775 if node.count - childrensamples > (0.1 * root.count):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	776 finalstring = '\033[91m' + finalstring + '\033[0m'
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	777 # Make frames that didn't actually perform work dark grey
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	778 elif node.count - childrensamples == 0:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	779 finalstring = '\033[90m' + finalstring + '\033[0m'
40384 fc4c598dd4a0 statprof: fix indent level of fp.write() (issue6004) Yuya Nishihara <yuya@tcha.org> parents: 40381 diff changeset	780 fp.write(finalstring + b'\n')
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	781
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	782 newdepth = depth
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	783 if len(visiblechildren) > 1 or multiple_siblings:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	784 newdepth += 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	785
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	786 visiblechildren.sort(reverse=True, key=lambda x: x.count)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	787 for child in visiblechildren:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	788 _write(child, newdepth, len(visiblechildren) > 1)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	789
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	790 if root.count > 0:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	791 _write(root, 0, False)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	792
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	793
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	794 def write_to_flame(data, fp, scriptpath=None, outputfile=None, **kwargs):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	795 if scriptpath is None:
30642 344e68882cd3 py3: replace os.environ with encoding.environ (part 4 of 5) Pulkit Goyal <7895pulkit@gmail.com> parents: 30583 diff changeset	796 scriptpath = encoding.environ['HOME'] + '/flamegraph.pl'
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	797 if not os.path.exists(scriptpath):
40198 9d3034348c4f py3: switch from print(..., file=) to write() Gregory Szorc <gregory.szorc@gmail.com> parents: 40197 diff changeset	798 fp.write(b'error: missing %s\n' % scriptpath)
9d3034348c4f py3: switch from print(..., file=) to write() Gregory Szorc <gregory.szorc@gmail.com> parents: 40197 diff changeset	799 fp.write(b'get it here: https://github.com/brendangregg/FlameGraph\n')
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	800 return
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	801
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	802 lines = {}
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	803 for sample in data.samples:
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	804 sites = [s.function for s in sample.stack]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	805 sites.reverse()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	806 line = ';'.join(sites)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	807 if line in lines:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	808 lines[line] = lines[line] + 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	809 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	810 lines[line] = 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	811
42845 db6d7cbda80b statprof: use context manager for file when writing flame graph Martin von Zweigbergk <martinvonz@google.com> parents: 42844 diff changeset	812 fd, path = pycompat.mkstemp()
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	813
42845 db6d7cbda80b statprof: use context manager for file when writing flame graph Martin von Zweigbergk <martinvonz@google.com> parents: 42844 diff changeset	814 with open(path, "w+") as file:
db6d7cbda80b statprof: use context manager for file when writing flame graph Martin von Zweigbergk <martinvonz@google.com> parents: 42844 diff changeset	815 for line, count in lines.iteritems():
db6d7cbda80b statprof: use context manager for file when writing flame graph Martin von Zweigbergk <martinvonz@google.com> parents: 42844 diff changeset	816 file.write("%s %d\n" % (line, count))
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	817
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	818 if outputfile is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	819 outputfile = '~/flamegraph.svg'
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	820
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	821 os.system("perl ~/flamegraph.pl %s > %s" % (path, outputfile))
40198 9d3034348c4f py3: switch from print(..., file=) to write() Gregory Szorc <gregory.szorc@gmail.com> parents: 40197 diff changeset	822 fp.write(b'Written to %s\n' % outputfile)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	823
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	824
30948 be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	825 _pathcache = {}
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	826
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	827
30948 be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	828 def simplifypath(path):
be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	829 '''Attempt to make the path to a Python module easier to read by
be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	830 removing whatever part of the Python search path it was found
be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	831 on.'''
be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	832
be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	833 if path in _pathcache:
be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	834 return _pathcache[path]
42847 cde1c101ab8a py3: make statprof's chrome output work Martin von Zweigbergk <martinvonz@google.com> parents: 42846 diff changeset	835 hgpath = encoding.__file__.rsplit(os.sep, 2)[0]
30948 be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	836 for p in [hgpath] + sys.path:
be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	837 prefix = p + os.sep
be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	838 if path.startswith(prefix):
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	839 path = path[len(prefix) :]
30948 be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	840 break
be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	841 _pathcache[path] = path
be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	842 return path
be3a4fde38eb statprof: add a path simplification function Bryan O'Sullivan <bryano@fb.com> parents: 30845 diff changeset	843
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	844
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	845 def write_to_json(data, fp):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	846 samples = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	847
30272 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30271 diff changeset	848 for sample in data.samples:
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	849 stack = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	850
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	851 for frame in sample.stack:
40535 8664fdc1cfb3 statprof: clean up unicode/bytes a little Augie Fackler <augie@google.com> parents: 40534 diff changeset	852 stack.append(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	853 (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	854 pycompat.sysstr(frame.path),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	855 frame.lineno,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	856 pycompat.sysstr(frame.function),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	857 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	858 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	859
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	860 samples.append((sample.time, stack))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	861
40191 4b7eb862692e py3: encode json output to bytes and use write() Gregory Szorc <gregory.szorc@gmail.com> parents: 39129 diff changeset	862 data = json.dumps(samples)
4b7eb862692e py3: encode json output to bytes and use write() Gregory Szorc <gregory.szorc@gmail.com> parents: 39129 diff changeset	863 if not isinstance(data, bytes):
4b7eb862692e py3: encode json output to bytes and use write() Gregory Szorc <gregory.szorc@gmail.com> parents: 39129 diff changeset	864 data = data.encode('utf-8')
4b7eb862692e py3: encode json output to bytes and use write() Gregory Szorc <gregory.szorc@gmail.com> parents: 39129 diff changeset	865
4b7eb862692e py3: encode json output to bytes and use write() Gregory Szorc <gregory.szorc@gmail.com> parents: 39129 diff changeset	866 fp.write(data)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	867
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	868
30949 cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	869 def write_to_chrome(data, fp, minthreshold=0.005, maxthreshold=0.999):
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	870 samples = []
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	871 laststack = collections.deque()
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	872 lastseen = collections.deque()
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	873
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	874 # The Chrome tracing format allows us to use a compact stack
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	875 # representation to save space. It's fiddly but worth it.
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	876 # We maintain a bijection between stack and ID.
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	877 stack2id = {}
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	878 id2stack = [] # will eventually be rendered
30949 cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	879
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	880 def stackid(stack):
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	881 if not stack:
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	882 return
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	883 if stack in stack2id:
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	884 return stack2id[stack]
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	885 parent = stackid(stack[1:])
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	886 myid = len(stack2id)
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	887 stack2id[stack] = myid
42847 cde1c101ab8a py3: make statprof's chrome output work Martin von Zweigbergk <martinvonz@google.com> parents: 42846 diff changeset	888 id2stack.append(dict(category=stack[0][0], name=r'%s %s' % stack[0]))
30949 cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	889 if parent is not None:
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	890 id2stack[-1].update(parent=parent)
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	891 return myid
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	892
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	893 # The sampling profiler can sample multiple times without
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	894 # advancing the clock, potentially causing the Chrome trace viewer
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	895 # to render single-pixel columns that we cannot zoom in on. We
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	896 # work around this by pretending that zero-duration samples are a
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	897 # millisecond in length.
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	898
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	899 clamp = 0.001
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	900
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	901 # We provide knobs that by default attempt to filter out stack
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	902 # frames that are too noisy:
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	903 #
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	904 # * A few take almost all execution time. These are usually boring
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	905 # setup functions, giving a stack that is deep but uninformative.
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	906 #
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	907 # * Numerous samples take almost no time, but introduce lots of
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	908 # noisy, oft-deep "spines" into a rendered profile.
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	909
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	910 blacklist = set()
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	911 totaltime = data.samples[-1].time - data.samples[0].time
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	912 minthreshold = totaltime * minthreshold
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	913 maxthreshold = max(totaltime * maxthreshold, clamp)
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	914
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	915 def poplast():
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	916 oldsid = stackid(tuple(laststack))
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	917 oldcat, oldfunc = laststack.popleft()
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	918 oldtime, oldidx = lastseen.popleft()
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	919 duration = sample.time - oldtime
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	920 if minthreshold <= duration <= maxthreshold:
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	921 # ensure no zero-duration events
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	922 sampletime = max(oldtime + clamp, sample.time)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	923 samples.append(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	924 dict(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	925 ph=r'E',
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	926 name=oldfunc,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	927 cat=oldcat,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	928 sf=oldsid,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	929 ts=sampletime * 1e6,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	930 pid=0,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	931 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	932 )
30949 cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	933 else:
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	934 blacklist.add(oldidx)
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	935
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	936 # Much fiddling to synthesize correctly(ish) nested begin/end
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	937 # events given only stack snapshots.
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	938
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	939 for sample in data.samples:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	940 stack = tuple(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	941 (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	942 (
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	943 r'%s:%d'
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	944 % (simplifypath(pycompat.sysstr(frame.path)), frame.lineno),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	945 pycompat.sysstr(frame.function),
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	946 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	947 for frame in sample.stack
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	948 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	949 )
30949 cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	950 qstack = collections.deque(stack)
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	951 if laststack == qstack:
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	952 continue
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	953 while laststack and qstack and laststack[-1] == qstack[-1]:
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	954 laststack.pop()
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	955 qstack.pop()
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	956 while laststack:
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	957 poplast()
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	958 for f in reversed(qstack):
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	959 lastseen.appendleft((sample.time, len(samples)))
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	960 laststack.appendleft(f)
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	961 path, name = f
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	962 sid = stackid(tuple(laststack))
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	963 samples.append(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	964 dict(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	965 ph=r'B',
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	966 name=name,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	967 cat=path,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	968 ts=sample.time * 1e6,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	969 sf=sid,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	970 pid=0,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	971 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	972 )
30949 cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	973 laststack = collections.deque(stack)
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	974 while laststack:
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	975 poplast()
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	976 events = [
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	977 sample for idx, sample in enumerate(samples) if idx not in blacklist
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	978 ]
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	979 frames = collections.OrderedDict(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	980 (str(k), v) for (k, v) in enumerate(id2stack)
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	981 )
42846 cd3b5be5515d py3: for statprof's Chrome output, write json to string, then encode to bytes Martin von Zweigbergk <martinvonz@google.com> parents: 42845 diff changeset	982 data = json.dumps(dict(traceEvents=events, stackFrames=frames), indent=1)
cd3b5be5515d py3: for statprof's Chrome output, write json to string, then encode to bytes Martin von Zweigbergk <martinvonz@google.com> parents: 42845 diff changeset	983 if not isinstance(data, bytes):
cd3b5be5515d py3: for statprof's Chrome output, write json to string, then encode to bytes Martin von Zweigbergk <martinvonz@google.com> parents: 42845 diff changeset	984 data = data.encode('utf-8')
cd3b5be5515d py3: for statprof's Chrome output, write json to string, then encode to bytes Martin von Zweigbergk <martinvonz@google.com> parents: 42845 diff changeset	985 fp.write(data)
30949 cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	986 fp.write('\n')
cb440e7af05d statprof: allow rendering in the Chrome trace viewer format Bryan O'Sullivan <bryano@fb.com> parents: 30948 diff changeset	987
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	988
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	989 def printusage():
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	990 print(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	991 r"""
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	992 The statprof command line allows you to inspect the last profile's results in
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	993 the following forms:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	994
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	995 usage:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	996 hotpath [-l --limit percent]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	997 Shows a graph of calls with the percent of time each takes.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	998 Red calls take over 10%% of the total time themselves.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	999 lines
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1000 Shows the actual sampled lines.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1001 functions
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1002 Shows the samples grouped by function.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1003 function [filename:]functionname
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1004 Shows the callers and callees of a particular function.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1005 flame [-s --script-path] [-o --output-file path]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1006 Writes out a flamegraph to output-file (defaults to ~/flamegraph.svg)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1007 Requires that ~/flamegraph.pl exist.
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	1008 (Specify alternate script path with --script-path.)"""
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	1009 )
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	1010
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1011
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1012 def main(argv=None):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1013 if argv is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1014 argv = sys.argv
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1015
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1016 if len(argv) == 1:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1017 printusage()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1018 return 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1019
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1020 displayargs = {}
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1021
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1022 optstart = 2
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1023 displayargs['function'] = None
40199 b594db74dc13 py3: use raw strings in statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: 40198 diff changeset	1024 if argv[1] == r'hotpath':
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1025 displayargs['format'] = DisplayFormats.Hotpath
40199 b594db74dc13 py3: use raw strings in statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: 40198 diff changeset	1026 elif argv[1] == r'lines':
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1027 displayargs['format'] = DisplayFormats.ByLine
40199 b594db74dc13 py3: use raw strings in statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: 40198 diff changeset	1028 elif argv[1] == r'functions':
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1029 displayargs['format'] = DisplayFormats.ByMethod
40199 b594db74dc13 py3: use raw strings in statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: 40198 diff changeset	1030 elif argv[1] == r'function':
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1031 displayargs['format'] = DisplayFormats.AboutMethod
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1032 displayargs['function'] = argv[2]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1033 optstart = 3
40199 b594db74dc13 py3: use raw strings in statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: 40198 diff changeset	1034 elif argv[1] == r'flame':
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1035 displayargs['format'] = DisplayFormats.FlameGraph
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1036 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1037 printusage()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1038 return 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1039
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1040 # process options
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1041 try:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	1042 opts, args = pycompat.getoptb(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	1043 sys.argv[optstart:],
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	1044 "hl:f:o:p:",
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	1045 ["help", "limit=", "file=", "output-file=", "script-path="],
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	1046 )
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1047 except getopt.error as msg:
30271 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30270 diff changeset	1048 print(msg)
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1049 printusage()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1050 return 2
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1051
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1052 displayargs['limit'] = 0.05
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1053 path = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1054 for o, value in opts:
40199 b594db74dc13 py3: use raw strings in statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: 40198 diff changeset	1055 if o in (r"-l", r"--limit"):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1056 displayargs['limit'] = float(value)
40199 b594db74dc13 py3: use raw strings in statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: 40198 diff changeset	1057 elif o in (r"-f", r"--file"):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1058 path = value
40199 b594db74dc13 py3: use raw strings in statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: 40198 diff changeset	1059 elif o in (r"-o", r"--output-file"):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1060 displayargs['outputfile'] = value
40199 b594db74dc13 py3: use raw strings in statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: 40198 diff changeset	1061 elif o in (r"-p", r"--script-path"):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1062 displayargs['scriptpath'] = value
40199 b594db74dc13 py3: use raw strings in statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: 40198 diff changeset	1063 elif o in (r"-h", r"help"):
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1064 printusage()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1065 return 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1066 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1067 assert False, "unhandled option %s" % o
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1068
30845 262c2be8ea5a statprof: require input file Gregory Szorc <gregory.szorc@gmail.com> parents: 30642 diff changeset	1069 if not path:
40199 b594db74dc13 py3: use raw strings in statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: 40198 diff changeset	1070 print(r'must specify --file to load')
30845 262c2be8ea5a statprof: require input file Gregory Szorc <gregory.szorc@gmail.com> parents: 30642 diff changeset	1071 return 1
262c2be8ea5a statprof: require input file Gregory Szorc <gregory.szorc@gmail.com> parents: 30642 diff changeset	1072
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1073 load_data(path=path)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1074
35379 c5853c9a6545 py3: handle keyword arguments correctly in statprof.py Pulkit Goyal <7895pulkit@gmail.com> parents: 32331 diff changeset	1075 display(**pycompat.strkwargs(displayargs))
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1076
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1077 return 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1078
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43053 diff changeset	1079
40199 b594db74dc13 py3: use raw strings in statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: 40198 diff changeset	1080 if __name__ == r"__main__":
30267 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1081 sys.exit(main())

Mercurial > public > mercurial-scm > hg-stable

annotate mercurial/statprof.py @ 43076:2372284d9457