mercurial-scm/hg: mercurial/statprof.py annotate

annotate mercurial/statprof.py @ 30578:c6ce11f2ee50

py3: make a bytes version of getopt.getopt() getopt.getopt() deals with unicodes on Python 3 internally and if bytes arguments are passed, then it will return TypeError. So we have now pycompat.getoptb() which takes bytes arguments, convert them to unicode, call getopt.getopt() and then convert the returned value back to bytes and then return those value. All the instances of getopt.getopt() are replaced with pycompat.getoptb().

author	Pulkit Goyal <7895pulkit@gmail.com>
date	Tue, 06 Dec 2016 06:36:36 +0530
parents	bb35fe8621f5
children	344e68882cd3

rev	line source
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1 #!/usr/bin/env python
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	2 ## statprof.py
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	3 ## Copyright (C) 2012 Bryan O'Sullivan <bos@serpentine.com>
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	4 ## Copyright (C) 2011 Alex Fraser <alex at phatcore dot com>
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	5 ## Copyright (C) 2004,2005 Andy Wingo <wingo at pobox dot com>
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	6 ## Copyright (C) 2001 Rob Browning <rlb at defaultvalue dot org>
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	7
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	8 ## This library is free software; you can redistribute it and/or
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	9 ## modify it under the terms of the GNU Lesser General Public
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	10 ## License as published by the Free Software Foundation; either
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	11 ## version 2.1 of the License, or (at your option) any later version.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	12 ##
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	13 ## This library is distributed in the hope that it will be useful,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	14 ## but WITHOUT ANY WARRANTY; without even the implied warranty of
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	15 ## MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	16 ## Lesser General Public License for more details.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	17 ##
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	18 ## You should have received a copy of the GNU Lesser General Public
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	19 ## License along with this program; if not, contact:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	20 ##
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	21 ## Free Software Foundation Voice: +1-617-542-5942
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	22 ## 59 Temple Place - Suite 330 Fax: +1-617-542-2652
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	23 ## Boston, MA 02111-1307, USA gnu@gnu.org
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	24
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	25 """
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	26 statprof is intended to be a fairly simple statistical profiler for
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	27 python. It was ported directly from a statistical profiler for guile,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	28 also named statprof, available from guile-lib [0].
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	29
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	30 [0] http://wingolog.org/software/guile-lib/statprof/
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	31
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	32 To start profiling, call statprof.start():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	33 >>> start()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	34
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	35 Then run whatever it is that you want to profile, for example:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	36 >>> import test.pystone; test.pystone.pystones()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	37
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	38 Then stop the profiling and print out the results:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	39 >>> stop()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	40 >>> display()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	41 % cumulative self
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	42 time seconds seconds name
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	43 26.72 1.40 0.37 pystone.py:79:Proc0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	44 13.79 0.56 0.19 pystone.py:133:Proc1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	45 13.79 0.19 0.19 pystone.py:208:Proc8
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	46 10.34 0.16 0.14 pystone.py:229:Func2
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	47 6.90 0.10 0.10 pystone.py:45:__init__
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	48 4.31 0.16 0.06 pystone.py:53:copy
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	49 ...
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	50
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	51 All of the numerical data is statistically approximate. In the
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	52 following column descriptions, and in all of statprof, "time" refers
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	53 to execution time (both user and system), not wall clock time.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	54
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	55 % time
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	56 The percent of the time spent inside the procedure itself (not
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	57 counting children).
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	58
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	59 cumulative seconds
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	60 The total number of seconds spent in the procedure, including
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	61 children.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	62
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	63 self seconds
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	64 The total number of seconds spent in the procedure itself (not
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	65 counting children).
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	66
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	67 name
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	68 The name of the procedure.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	69
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	70 By default statprof keeps the data collected from previous runs. If you
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	71 want to clear the collected data, call reset():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	72 >>> reset()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	73
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	74 reset() can also be used to change the sampling frequency from the
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	75 default of 1000 Hz. For example, to tell statprof to sample 50 times a
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	76 second:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	77 >>> reset(50)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	78
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	79 This means that statprof will sample the call stack after every 1/50 of
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	80 a second of user + system time spent running on behalf of the python
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	81 process. When your process is idle (for example, blocking in a read(),
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	82 as is the case at the listener), the clock does not advance. For this
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	83 reason statprof is not currently not suitable for profiling io-bound
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	84 operations.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	85
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	86 The profiler uses the hash of the code object itself to identify the
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	87 procedures, so it won't confuse different procedures with the same name.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	88 They will show up as two different rows in the output.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	89
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	90 Right now the profiler is quite simplistic. I cannot provide
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	91 call-graphs or other higher level information. What you see in the
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	92 table is pretty much all there is. Patches are welcome :-)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	93
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	94
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	95 Threading
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	96 ---------
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	97
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	98 Because signals only get delivered to the main thread in Python,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	99 statprof only profiles the main thread. However because the time
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	100 reporting function uses per-process timers, the results can be
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	101 significantly off if other threads' work patterns are not similar to the
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	102 main thread's work patterns.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	103 """
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	104 # no-check-code
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	105 from __future__ import absolute_import, division, print_function
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	106
30256 2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	107 import collections
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	108 import contextlib
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	109 import getopt
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	110 import inspect
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	111 import json
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	112 import os
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	113 import signal
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	114 import sys
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	115 import tempfile
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	116 import threading
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	117 import time
30256 2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	118
30578 c6ce11f2ee50 py3: make a bytes version of getopt.getopt() Pulkit Goyal <7895pulkit@gmail.com> parents: 30568 diff changeset	119 from . import (
c6ce11f2ee50 py3: make a bytes version of getopt.getopt() Pulkit Goyal <7895pulkit@gmail.com> parents: 30568 diff changeset	120 pycompat,
c6ce11f2ee50 py3: make a bytes version of getopt.getopt() Pulkit Goyal <7895pulkit@gmail.com> parents: 30568 diff changeset	121 )
c6ce11f2ee50 py3: make a bytes version of getopt.getopt() Pulkit Goyal <7895pulkit@gmail.com> parents: 30568 diff changeset	122
30256 2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	123 defaultdict = collections.defaultdict
2ed0b3f9f79e statprof: use absolute_imports Gregory Szorc <gregory.szorc@gmail.com> parents: 30255 diff changeset	124 contextmanager = contextlib.contextmanager
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	125
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	126 __all__ = ['start', 'stop', 'reset', 'display', 'profile']
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	127
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	128 skips = set(["util.py:check", "extensions.py:closure",
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	129 "color.py:colorcmd", "dispatch.py:checkargs",
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	130 "dispatch.py:<lambda>", "dispatch.py:_runcatch",
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	131 "dispatch.py:_dispatch", "dispatch.py:_runcommand",
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	132 "pager.py:pagecmd", "dispatch.py:run",
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	133 "dispatch.py:dispatch", "dispatch.py:runcommand",
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	134 "hg.py:<module>", "evolve.py:warnobserrors",
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	135 ])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	136
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	137 ###########################################################################
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	138 ## Utils
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	139
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	140 def clock():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	141 times = os.times()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	142 return times[0] + times[1]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	143
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	144
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	145 ###########################################################################
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	146 ## Collection data structures
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	147
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	148 class ProfileState(object):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	149 def __init__(self, frequency=None):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	150 self.reset(frequency)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	151
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	152 def reset(self, frequency=None):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	153 # total so far
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	154 self.accumulated_time = 0.0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	155 # start_time when timer is active
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	156 self.last_start_time = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	157 # a float
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	158 if frequency:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	159 self.sample_interval = 1.0 / frequency
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	160 elif not hasattr(self, 'sample_interval'):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	161 # default to 1000 Hz
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	162 self.sample_interval = 1.0 / 1000.0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	163 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	164 # leave the frequency as it was
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	165 pass
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	166 self.remaining_prof_time = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	167 # for user start/stop nesting
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	168 self.profile_level = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	169
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	170 self.samples = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	171
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	172 def accumulate_time(self, stop_time):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	173 self.accumulated_time += stop_time - self.last_start_time
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	174
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	175 def seconds_per_sample(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	176 return self.accumulated_time / len(self.samples)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	177
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	178 state = ProfileState()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	179
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	180
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	181 class CodeSite(object):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	182 cache = {}
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	183
30568 bb35fe8621f5 py3: use unicodes in __slots__ Pulkit Goyal <7895pulkit@gmail.com> parents: 30299 diff changeset	184 __slots__ = (u'path', u'lineno', u'function', u'source')
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	185
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	186 def __init__(self, path, lineno, function):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	187 self.path = path
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	188 self.lineno = lineno
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	189 self.function = function
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	190 self.source = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	191
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	192 def __eq__(self, other):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	193 try:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	194 return (self.lineno == other.lineno and
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	195 self.path == other.path)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	196 except:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	197 return False
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	198
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	199 def __hash__(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	200 return hash((self.lineno, self.path))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	201
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	202 @classmethod
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	203 def get(cls, path, lineno, function):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	204 k = (path, lineno)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	205 try:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	206 return cls.cache[k]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	207 except KeyError:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	208 v = cls(path, lineno, function)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	209 cls.cache[k] = v
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	210 return v
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	211
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	212 def getsource(self, length):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	213 if self.source is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	214 lineno = self.lineno - 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	215 fp = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	216 try:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	217 fp = open(self.path)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	218 for i, line in enumerate(fp):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	219 if i == lineno:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	220 self.source = line.strip()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	221 break
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	222 except:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	223 pass
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	224 finally:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	225 if fp:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	226 fp.close()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	227 if self.source is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	228 self.source = ''
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	229
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	230 source = self.source
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	231 if len(source) > length:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	232 source = source[:(length - 3)] + "..."
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	233 return source
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	234
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	235 def filename(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	236 return os.path.basename(self.path)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	237
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	238 class Sample(object):
30568 bb35fe8621f5 py3: use unicodes in __slots__ Pulkit Goyal <7895pulkit@gmail.com> parents: 30299 diff changeset	239 __slots__ = (u'stack', u'time')
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	240
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	241 def __init__(self, stack, time):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	242 self.stack = stack
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	243 self.time = time
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	244
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	245 @classmethod
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	246 def from_frame(cls, frame, time):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	247 stack = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	248
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	249 while frame:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	250 stack.append(CodeSite.get(frame.f_code.co_filename, frame.f_lineno,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	251 frame.f_code.co_name))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	252 frame = frame.f_back
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	253
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	254 return Sample(stack, time)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	255
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	256 ###########################################################################
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	257 ## SIGPROF handler
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	258
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	259 def profile_signal_handler(signum, frame):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	260 if state.profile_level > 0:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	261 now = clock()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	262 state.accumulate_time(now)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	263
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	264 state.samples.append(Sample.from_frame(frame, state.accumulated_time))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	265
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	266 signal.setitimer(signal.ITIMER_PROF,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	267 state.sample_interval, 0.0)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	268 state.last_start_time = now
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	269
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	270 stopthread = threading.Event()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	271 def samplerthread(tid):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	272 while not stopthread.is_set():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	273 now = clock()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	274 state.accumulate_time(now)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	275
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	276 frame = sys._current_frames()[tid]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	277 state.samples.append(Sample.from_frame(frame, state.accumulated_time))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	278
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	279 state.last_start_time = now
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	280 time.sleep(state.sample_interval)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	281
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	282 stopthread.clear()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	283
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	284 ###########################################################################
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	285 ## Profiling API
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	286
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	287 def is_active():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	288 return state.profile_level > 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	289
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	290 lastmechanism = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	291 def start(mechanism='thread'):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	292 '''Install the profiling signal handler, and start profiling.'''
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	293 state.profile_level += 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	294 if state.profile_level == 1:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	295 state.last_start_time = clock()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	296 rpt = state.remaining_prof_time
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	297 state.remaining_prof_time = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	298
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	299 global lastmechanism
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	300 lastmechanism = mechanism
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	301
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	302 if mechanism == 'signal':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	303 signal.signal(signal.SIGPROF, profile_signal_handler)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	304 signal.setitimer(signal.ITIMER_PROF,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	305 rpt or state.sample_interval, 0.0)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	306 elif mechanism == 'thread':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	307 frame = inspect.currentframe()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	308 tid = [k for k, f in sys._current_frames().items() if f == frame][0]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	309 state.thread = threading.Thread(target=samplerthread,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	310 args=(tid,), name="samplerthread")
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	311 state.thread.start()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	312
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	313 def stop():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	314 '''Stop profiling, and uninstall the profiling signal handler.'''
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	315 state.profile_level -= 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	316 if state.profile_level == 0:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	317 if lastmechanism == 'signal':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	318 rpt = signal.setitimer(signal.ITIMER_PROF, 0.0, 0.0)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	319 signal.signal(signal.SIGPROF, signal.SIG_IGN)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	320 state.remaining_prof_time = rpt[0]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	321 elif lastmechanism == 'thread':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	322 stopthread.set()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	323 state.thread.join()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	324
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	325 state.accumulate_time(clock())
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	326 state.last_start_time = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	327 statprofpath = os.environ.get('STATPROF_DEST')
30255 f42cd5434cc2 statprof: require paths to save or load profile data Gregory Szorc <gregory.szorc@gmail.com> parents: 30254 diff changeset	328 if statprofpath:
f42cd5434cc2 statprof: require paths to save or load profile data Gregory Szorc <gregory.szorc@gmail.com> parents: 30254 diff changeset	329 save_data(statprofpath)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	330
30299 1e5346313963 statprof: return state from stop() Gregory Szorc <gregory.szorc@gmail.com> parents: 30258 diff changeset	331 return state
1e5346313963 statprof: return state from stop() Gregory Szorc <gregory.szorc@gmail.com> parents: 30258 diff changeset	332
30255 f42cd5434cc2 statprof: require paths to save or load profile data Gregory Szorc <gregory.szorc@gmail.com> parents: 30254 diff changeset	333 def save_data(path):
f42cd5434cc2 statprof: require paths to save or load profile data Gregory Szorc <gregory.szorc@gmail.com> parents: 30254 diff changeset	334 with open(path, 'w+') as file:
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	335 file.write(str(state.accumulated_time) + '\n')
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	336 for sample in state.samples:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	337 time = str(sample.time)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	338 stack = sample.stack
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	339 sites = ['\1'.join([s.path, str(s.lineno), s.function])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	340 for s in stack]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	341 file.write(time + '\0' + '\0'.join(sites) + '\n')
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	342
30255 f42cd5434cc2 statprof: require paths to save or load profile data Gregory Szorc <gregory.szorc@gmail.com> parents: 30254 diff changeset	343 def load_data(path):
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	344 lines = open(path, 'r').read().splitlines()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	345
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	346 state.accumulated_time = float(lines[0])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	347 state.samples = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	348 for line in lines[1:]:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	349 parts = line.split('\0')
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	350 time = float(parts[0])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	351 rawsites = parts[1:]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	352 sites = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	353 for rawsite in rawsites:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	354 siteparts = rawsite.split('\1')
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	355 sites.append(CodeSite.get(siteparts[0], int(siteparts[1]),
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	356 siteparts[2]))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	357
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	358 state.samples.append(Sample(sites, time))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	359
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	360
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	361
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	362 def reset(frequency=None):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	363 '''Clear out the state of the profiler. Do not call while the
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	364 profiler is running.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	365
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	366 The optional frequency argument specifies the number of samples to
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	367 collect per second.'''
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	368 assert state.profile_level == 0, "Can't reset() while statprof is running"
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	369 CodeSite.cache.clear()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	370 state.reset(frequency)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	371
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	372
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	373 @contextmanager
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	374 def profile():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	375 start()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	376 try:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	377 yield
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	378 finally:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	379 stop()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	380 display()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	381
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	382
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	383 ###########################################################################
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	384 ## Reporting API
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	385
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	386 class SiteStats(object):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	387 def __init__(self, site):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	388 self.site = site
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	389 self.selfcount = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	390 self.totalcount = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	391
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	392 def addself(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	393 self.selfcount += 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	394
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	395 def addtotal(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	396 self.totalcount += 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	397
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	398 def selfpercent(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	399 return self.selfcount / len(state.samples) * 100
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	400
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	401 def totalpercent(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	402 return self.totalcount / len(state.samples) * 100
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	403
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	404 def selfseconds(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	405 return self.selfcount * state.seconds_per_sample()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	406
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	407 def totalseconds(self):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	408 return self.totalcount * state.seconds_per_sample()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	409
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	410 @classmethod
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	411 def buildstats(cls, samples):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	412 stats = {}
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	413
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	414 for sample in samples:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	415 for i, site in enumerate(sample.stack):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	416 sitestat = stats.get(site)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	417 if not sitestat:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	418 sitestat = SiteStats(site)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	419 stats[site] = sitestat
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	420
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	421 sitestat.addtotal()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	422
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	423 if i == 0:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	424 sitestat.addself()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	425
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	426 return [s for s in stats.itervalues()]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	427
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	428 class DisplayFormats:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	429 ByLine = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	430 ByMethod = 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	431 AboutMethod = 2
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	432 Hotpath = 3
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	433 FlameGraph = 4
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	434 Json = 5
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	435
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	436 def display(fp=None, format=3, data=None, **kwargs):
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	437 '''Print statistics, either to stdout or the given file object.'''
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	438 data = data or state
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	439
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	440 if fp is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	441 import sys
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	442 fp = sys.stdout
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	443 if len(data.samples) == 0:
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	444 print('No samples recorded.', file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	445 return
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	446
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	447 if format == DisplayFormats.ByLine:
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	448 display_by_line(data, fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	449 elif format == DisplayFormats.ByMethod:
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	450 display_by_method(data, fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	451 elif format == DisplayFormats.AboutMethod:
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	452 display_about_method(data, fp, **kwargs)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	453 elif format == DisplayFormats.Hotpath:
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	454 display_hotpath(data, fp, **kwargs)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	455 elif format == DisplayFormats.FlameGraph:
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	456 write_to_flame(data, fp, **kwargs)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	457 elif format == DisplayFormats.Json:
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	458 write_to_json(data, fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	459 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	460 raise Exception("Invalid display format")
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	461
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	462 if format != DisplayFormats.Json:
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	463 print('---', file=fp)
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	464 print('Sample count: %d' % len(data.samples), file=fp)
eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	465 print('Total time: %f seconds' % data.accumulated_time, file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	466
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	467 def display_by_line(data, fp):
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	468 '''Print the profiler data with each sample line represented
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	469 as one row in a table. Sorted by self-time per line.'''
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	470 stats = SiteStats.buildstats(data.samples)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	471 stats.sort(reverse=True, key=lambda x: x.selfseconds())
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	472
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	473 print('%5.5s %10.10s %7.7s %-8.8s' %
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	474 ('% ', 'cumulative', 'self', ''), file=fp)
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	475 print('%5.5s %9.9s %8.8s %-8.8s' %
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	476 ("time", "seconds", "seconds", "name"), file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	477
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	478 for stat in stats:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	479 site = stat.site
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	480 sitelabel = '%s:%d:%s' % (site.filename(), site.lineno, site.function)
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	481 print('%6.2f %9.2f %9.2f %s' % (stat.selfpercent(),
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	482 stat.totalseconds(),
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	483 stat.selfseconds(),
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	484 sitelabel),
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	485 file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	486
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	487 def display_by_method(data, fp):
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	488 '''Print the profiler data with each sample function represented
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	489 as one row in a table. Important lines within that function are
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	490 output as nested rows. Sorted by self-time per line.'''
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	491 print('%5.5s %10.10s %7.7s %-8.8s' %
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	492 ('% ', 'cumulative', 'self', ''), file=fp)
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	493 print('%5.5s %9.9s %8.8s %-8.8s' %
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	494 ("time", "seconds", "seconds", "name"), file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	495
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	496 stats = SiteStats.buildstats(data.samples)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	497
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	498 grouped = defaultdict(list)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	499 for stat in stats:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	500 grouped[stat.site.filename() + ":" + stat.site.function].append(stat)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	501
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	502 # compute sums for each function
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	503 functiondata = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	504 for fname, sitestats in grouped.iteritems():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	505 total_cum_sec = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	506 total_self_sec = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	507 total_percent = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	508 for stat in sitestats:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	509 total_cum_sec += stat.totalseconds()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	510 total_self_sec += stat.selfseconds()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	511 total_percent += stat.selfpercent()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	512
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	513 functiondata.append((fname,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	514 total_cum_sec,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	515 total_self_sec,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	516 total_percent,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	517 sitestats))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	518
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	519 # sort by total self sec
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	520 functiondata.sort(reverse=True, key=lambda x: x[2])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	521
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	522 for function in functiondata:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	523 if function[3] < 0.05:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	524 continue
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	525 print('%6.2f %9.2f %9.2f %s' % (function[3], # total percent
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	526 function[1], # total cum sec
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	527 function[2], # total self sec
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	528 function[0]), # file:function
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	529 file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	530 function[4].sort(reverse=True, key=lambda i: i.selfseconds())
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	531 for stat in function[4]:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	532 # only show line numbers for significant locations (>1% time spent)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	533 if stat.selfpercent() > 1:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	534 source = stat.site.getsource(25)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	535 stattuple = (stat.selfpercent(), stat.selfseconds(),
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	536 stat.site.lineno, source)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	537
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	538 print('%33.0f%% %6.2f line %s: %s' % (stattuple), file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	539
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	540 def display_about_method(data, fp, function=None, **kwargs):
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	541 if function is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	542 raise Exception("Invalid function")
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	543
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	544 filename = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	545 if ':' in function:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	546 filename, function = function.split(':')
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	547
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	548 relevant_samples = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	549 parents = {}
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	550 children = {}
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	551
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	552 for sample in data.samples:
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	553 for i, site in enumerate(sample.stack):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	554 if site.function == function and (not filename
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	555 or site.filename() == filename):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	556 relevant_samples += 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	557 if i != len(sample.stack) - 1:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	558 parent = sample.stack[i + 1]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	559 if parent in parents:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	560 parents[parent] = parents[parent] + 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	561 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	562 parents[parent] = 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	563
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	564 if site in children:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	565 children[site] = children[site] + 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	566 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	567 children[site] = 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	568
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	569 parents = [(parent, count) for parent, count in parents.iteritems()]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	570 parents.sort(reverse=True, key=lambda x: x[1])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	571 for parent, count in parents:
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	572 print('%6.2f%% %s:%s line %s: %s' %
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	573 (count / relevant_samples * 100, parent.filename(),
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	574 parent.function, parent.lineno, parent.getsource(50)), file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	575
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	576 stats = SiteStats.buildstats(data.samples)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	577 stats = [s for s in stats
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	578 if s.site.function == function and
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	579 (not filename or s.site.filename() == filename)]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	580
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	581 total_cum_sec = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	582 total_self_sec = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	583 total_self_percent = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	584 total_cum_percent = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	585 for stat in stats:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	586 total_cum_sec += stat.totalseconds()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	587 total_self_sec += stat.selfseconds()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	588 total_self_percent += stat.selfpercent()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	589 total_cum_percent += stat.totalpercent()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	590
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	591 print(
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	592 '\n %s:%s Total: %0.2fs (%0.2f%%) Self: %0.2fs (%0.2f%%)\n' %
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	593 (
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	594 filename or '___',
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	595 function,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	596 total_cum_sec,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	597 total_cum_percent,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	598 total_self_sec,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	599 total_self_percent
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	600 ), file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	601
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	602 children = [(child, count) for child, count in children.iteritems()]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	603 children.sort(reverse=True, key=lambda x: x[1])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	604 for child, count in children:
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	605 print(' %6.2f%% line %s: %s' %
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	606 (count / relevant_samples * 100, child.lineno,
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	607 child.getsource(50)), file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	608
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	609 def display_hotpath(data, fp, limit=0.05, **kwargs):
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	610 class HotNode(object):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	611 def __init__(self, site):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	612 self.site = site
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	613 self.count = 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	614 self.children = {}
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	615
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	616 def add(self, stack, time):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	617 self.count += time
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	618 site = stack[0]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	619 child = self.children.get(site)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	620 if not child:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	621 child = HotNode(site)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	622 self.children[site] = child
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	623
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	624 if len(stack) > 1:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	625 i = 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	626 # Skip boiler plate parts of the stack
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	627 while i < len(stack) and '%s:%s' % (stack[i].filename(), stack[i].function) in skips:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	628 i += 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	629 if i < len(stack):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	630 child.add(stack[i:], time)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	631
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	632 root = HotNode(None)
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	633 lasttime = data.samples[0].time
eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	634 for sample in data.samples:
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	635 root.add(sample.stack[::-1], sample.time - lasttime)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	636 lasttime = sample.time
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	637
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	638 def _write(node, depth, multiple_siblings):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	639 site = node.site
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	640 visiblechildren = [c for c in node.children.itervalues()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	641 if c.count >= (limit * root.count)]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	642 if site:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	643 indent = depth * 2 - 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	644 filename = ''
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	645 function = ''
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	646 if len(node.children) > 0:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	647 childsite = list(node.children.itervalues())[0].site
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	648 filename = (childsite.filename() + ':').ljust(15)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	649 function = childsite.function
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	650
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	651 # lots of string formatting
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	652 listpattern = ''.ljust(indent) +\
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	653 ('\\' if multiple_siblings else '\|') +\
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	654 ' %4.1f%% %s %s'
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	655 liststring = listpattern % (node.count / root.count * 100,
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	656 filename, function)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	657 codepattern = '%' + str(55 - len(liststring)) + 's %s: %s'
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	658 codestring = codepattern % ('line', site.lineno, site.getsource(30))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	659
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	660 finalstring = liststring + codestring
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	661 childrensamples = sum([c.count for c in node.children.itervalues()])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	662 # Make frames that performed more than 10% of the operation red
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	663 if node.count - childrensamples > (0.1 * root.count):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	664 finalstring = '\033[91m' + finalstring + '\033[0m'
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	665 # Make frames that didn't actually perform work dark grey
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	666 elif node.count - childrensamples == 0:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	667 finalstring = '\033[90m' + finalstring + '\033[0m'
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	668 print(finalstring, file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	669
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	670 newdepth = depth
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	671 if len(visiblechildren) > 1 or multiple_siblings:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	672 newdepth += 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	673
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	674 visiblechildren.sort(reverse=True, key=lambda x: x.count)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	675 for child in visiblechildren:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	676 _write(child, newdepth, len(visiblechildren) > 1)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	677
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	678 if root.count > 0:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	679 _write(root, 0, False)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	680
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	681 def write_to_flame(data, fp, scriptpath=None, outputfile=None, **kwargs):
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	682 if scriptpath is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	683 scriptpath = os.environ['HOME'] + '/flamegraph.pl'
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	684 if not os.path.exists(scriptpath):
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	685 print("error: missing %s" % scriptpath, file=fp)
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	686 print("get it here: https://github.com/brendangregg/FlameGraph",
7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	687 file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	688 return
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	689
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	690 fd, path = tempfile.mkstemp()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	691
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	692 file = open(path, "w+")
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	693
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	694 lines = {}
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	695 for sample in data.samples:
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	696 sites = [s.function for s in sample.stack]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	697 sites.reverse()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	698 line = ';'.join(sites)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	699 if line in lines:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	700 lines[line] = lines[line] + 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	701 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	702 lines[line] = 1
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	703
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	704 for line, count in lines.iteritems():
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	705 file.write("%s %s\n" % (line, count))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	706
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	707 file.close()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	708
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	709 if outputfile is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	710 outputfile = '~/flamegraph.svg'
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	711
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	712 os.system("perl ~/flamegraph.pl %s > %s" % (path, outputfile))
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	713 print("Written to %s" % outputfile, file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	714
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	715 def write_to_json(data, fp):
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	716 samples = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	717
30258 eea89068a98d statprof: pass data structure to display functions Gregory Szorc <gregory.szorc@gmail.com> parents: 30257 diff changeset	718 for sample in data.samples:
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	719 stack = []
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	720
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	721 for frame in sample.stack:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	722 stack.append((frame.path, frame.lineno, frame.function))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	723
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	724 samples.append((sample.time, stack))
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	725
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	726 print(json.dumps(samples), file=fp)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	727
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	728 def printusage():
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	729 print("""
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	730 The statprof command line allows you to inspect the last profile's results in
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	731 the following forms:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	732
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	733 usage:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	734 hotpath [-l --limit percent]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	735 Shows a graph of calls with the percent of time each takes.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	736 Red calls take over 10%% of the total time themselves.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	737 lines
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	738 Shows the actual sampled lines.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	739 functions
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	740 Shows the samples grouped by function.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	741 function [filename:]functionname
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	742 Shows the callers and callees of a particular function.
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	743 flame [-s --script-path] [-o --output-file path]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	744 Writes out a flamegraph to output-file (defaults to ~/flamegraph.svg)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	745 Requires that ~/flamegraph.pl exist.
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	746 (Specify alternate script path with --script-path.)""")
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	747
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	748 def main(argv=None):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	749 if argv is None:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	750 argv = sys.argv
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	751
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	752 if len(argv) == 1:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	753 printusage()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	754 return 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	755
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	756 displayargs = {}
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	757
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	758 optstart = 2
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	759 displayargs['function'] = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	760 if argv[1] == 'hotpath':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	761 displayargs['format'] = DisplayFormats.Hotpath
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	762 elif argv[1] == 'lines':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	763 displayargs['format'] = DisplayFormats.ByLine
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	764 elif argv[1] == 'functions':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	765 displayargs['format'] = DisplayFormats.ByMethod
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	766 elif argv[1] == 'function':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	767 displayargs['format'] = DisplayFormats.AboutMethod
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	768 displayargs['function'] = argv[2]
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	769 optstart = 3
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	770 elif argv[1] == 'flame':
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	771 displayargs['format'] = DisplayFormats.FlameGraph
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	772 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	773 printusage()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	774 return 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	775
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	776 # process options
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	777 try:
30578 c6ce11f2ee50 py3: make a bytes version of getopt.getopt() Pulkit Goyal <7895pulkit@gmail.com> parents: 30568 diff changeset	778 opts, args = pycompat.getoptb(sys.argv[optstart:], "hl:f:o:p:",
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	779 ["help", "limit=", "file=", "output-file=", "script-path="])
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	780 except getopt.error as msg:
30257 7428223ed7c2 statprof: use print function Gregory Szorc <gregory.szorc@gmail.com> parents: 30256 diff changeset	781 print(msg)
30253 b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	782 printusage()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	783 return 2
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	784
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	785 displayargs['limit'] = 0.05
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	786 path = None
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	787 for o, value in opts:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	788 if o in ("-l", "--limit"):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	789 displayargs['limit'] = float(value)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	790 elif o in ("-f", "--file"):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	791 path = value
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	792 elif o in ("-o", "--output-file"):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	793 displayargs['outputfile'] = value
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	794 elif o in ("-p", "--script-path"):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	795 displayargs['scriptpath'] = value
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	796 elif o in ("-h", "help"):
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	797 printusage()
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	798 return 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	799 else:
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	800 assert False, "unhandled option %s" % o
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	801
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	802 load_data(path=path)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	803
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	804 display(**displayargs)
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	805
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	806 return 0
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	807
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	808 if __name__ == "__main__":
b032a7b676c6 statprof: vendor statprof.py Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	809 sys.exit(main())

Mercurial > public > mercurial-scm > hg

annotate mercurial/statprof.py @ 30578:c6ce11f2ee50