How do I profile memory usage in Python?

This one has been answered already here: Python memory profiler

Basically you do something like that (cited from Guppy-PE):

>>> from guppy import hpy; h=hpy()
>>> h.heap()
Partition of a set of 48477 objects. Total size = 3265516 bytes.
 Index  Count   %     Size   % Cumulative  % Kind (class / dict of class)
     0  25773  53  1612820  49   1612820  49 str
     1  11699  24   483960  15   2096780  64 tuple
     2    174   0   241584   7   2338364  72 dict of module
     3   3478   7   222592   7   2560956  78 types.CodeType
     4   3296   7   184576   6   2745532  84 function
     5    401   1   175112   5   2920644  89 dict of class
     6    108   0    81888   3   3002532  92 dict (no owner)
     7    114   0    79632   2   3082164  94 dict of type
     8    117   0    51336   2   3133500  96 type
     9    667   1    24012   1   3157512  97 __builtin__.wrapper_descriptor
<76 more rows. Type e.g. '_.more' to view.>
>>> h.iso(1,[],{})
Partition of a set of 3 objects. Total size = 176 bytes.
 Index  Count   %     Size   % Cumulative  % Kind (class / dict of class)
     0      1  33      136  77       136  77 dict (no owner)
     1      1  33       28  16       164  93 list
     2      1  33       12   7       176 100 int
>>> x=[]
>>> h.iso(x).sp
 0: h.Root.i0_modules['__main__'].__dict__['x']
>>>

Related Posts:

  1. How can I explicitly free memory in Python?
  2. How to clear variables in ipython?
  3. How can you profile a Python script?
  4. How to clear variables in ipython?
  5. How does the “view” method work in PyTorch?
  6. In Python, what is `sys.maxsize`?
  7. How do I determine the size of an object in Python?
  8. SyntaxError: unexpected EOF while parsing
  9. ValueError: operands could not be broadcast together with shapes (5,) (30,)
  10. appending list but error ‘NoneType’ object has no attribute ‘append’
  11. Using Python 3 in virtualenv
  12. “Series objects are mutable and cannot be hashed” error
  13. Putting a simple if-then-else statement on one line [duplicate]
  14. matplotlib savefig() plots different from show()
  15. Converting list to numpy array
  16. How do I parse a string to a float or int?
  17. Check if something is (not) in a list in Python
  18. How to parse data in JSON format?
  19. TypeError: unhashable type: ‘dict’
  20. ‘Conda’ is not recognized as internal or external command
  21. Python list of dictionaries search
  22. Extract file name from path, no matter what the os/path format
  23. How do I insert a JPEG image into a python Tkinter window?
  24. Use a.any() or a.all()
  25. What is the difference between Spyder and Jupyter?
  26. What is the maximum recursion depth in Python, and how to increase it?
  27. subprocess.check_output return code
  28. Is arr.__len__() the preferred way to get the length of an array in Python?
  29. Running Python from Atom
  30. TypeError: can’t use a string pattern on a bytes-like object in re.findall()
  31. What is the difference between “is None” and “== None”
  32. Why Python 3.6.1 throws AttributeError: module ‘enum’ has no attribute ‘IntFlag’?
  33. Python subprocess.Popen “OSError: [Errno 12] Cannot allocate memory”
  34. Creating 2D dictionary in Python
  35. Python: slicing a multi-dimensional array
  36. Python: pandas merge multiple dataframes
  37. Shuffle an array with python, randomize array item order with python
  38. Which Python memory profiler is recommended? [closed]
  39. How to count the NaN values in a column in pandas DataFrame
  40. How to install multiple python packages at once using pip
  41. Running Selenium with Headless Chrome Webdriver
  42. boto3 client NoRegionError: You must specify a region error only sometimes
  43. Converting Dictionary to List?
  44. pip3: command not found
  45. How to get keyboard input in pygame?
  46. How to use sys.exit() in Python
  47. How to convert string to binary?
  48. How to iterate through two lists in parallel?
  49. Make list of arrays in python
  50. Pyspark: Exception: Java gateway process exited before sending the driver its port number
  51. Converting from a string to boolean in Python?
  52. Import Error: No module named numpy Anaconda
  53. How to remove \n from a list element?
  54. How to add an empty column to a dataframe?
  55. Virtualenv Command Not Found
  56. python pip on Windows – command ‘cl.exe’ failed
  57. pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available
  58. Extract part of a regex match
  59. Python “SyntaxError: Non-ASCII character ‘\xe2’ in file”
  60. Why is there no tuple comprehension in Python?
  61. You are trying to add a non-nullable field ‘new_field’ to userprofile without a default
  62. How to calculate a Gaussian kernel matrix efficiently in numpy?
  63. AttributeError: Can only use .str accessor with string values, which use np.object_ dtype in pandas
  64. Python Pandas ValueError Arrays Must be All Same Length
  65. Anaconda / Python: Change Anaconda Prompt User Path
  66. Pycharm and sys.argv arguments
  67. ImportError: No module named ‘yaml’
  68. TypeError: ‘_io.TextIOWrapper’ object is not subscriptable
  69. super(type, obj): obj must be an instance or subtype of type
  70. What does “hashable” mean in Pytho
  71. Python multiprocessing.Pool: AttributeError
  72. Convert string to ASCII value python
  73. Scikit-learn GridSearch giving “ValueError: multiclass format is not supported” error
  74. Convert R code into Python code using rpy2
  75. PIL: DLL load failed: specified procedure could not be found
  76. “Cannot access setup.py: No such file or directory” – can’t run any .py files?
  77. How to delete a specific line in a file?
  78. How does ajax work with python?
  79. RSA encryption and decryption in Python
  80. pip3 error – ‘_NamespacePath’ object has no attribute ‘sort’
  81. What does {0} mean in this Python string?
  82. Tab Error in Python
  83. Installation of pygame with Anaconda
  84. Is there a Python equivalent of the C# null-coalescing operator?
  85. Python 3.6 import requests
  86. Tensorflow 2.0 – AttributeError: module ‘tensorflow’ has no attribute ‘Session’
  87. What is key=lambda
  88. Counting array elements in Python
  89. IPython, “name ‘plt’ not defined”
  90. What is the meaning of “int(a[::-1])” in Python?
  91. Pandas unstack problems: ValueError: Index contains duplicate entries, cannot reshape
  92. How do I read image data from a URL in Python?
  93. Python: Convert timedelta to int in a dataframe
  94. Can’t concat bytes to str
  95. ‘pyuic5’ is not recognized as an internal or external command
  96. ValueError: multiclass format is not supported
  97. Filtering a NumPy Array
  98. Invalid syntax when using “print”?
  99. Error loading MySQLdb module: No module named ‘MySQLdb’
  100. Unable to install boto3

Leave a Comment