How to get line count of a large file cheaply in Python?

You can’t get any better than that.

After all, any solution will have to read the entire file, figure out how many \n you have, and return that result.

Do you have a better way of doing that without reading the entire file? Not sure… The best solution will always be I/O-bound, best you can do is make sure you don’t use unnecessary memory, but it looks like you have that covered.

Related Posts:

  1. Float must be a string or a number?
  2. How to convert list to string [duplicate]
  3. How to uninstall a package installed with pip install –user
  4. numpy max vs amax vs maximum
  5. TypeError: ‘str’ object is not callable (Python)
  6. ValueError: invalid literal for int() with base 10: ”
  7. Print string to text file
  8. How can I parse a YAML file in Python
  9. Asking the user for input until they give a valid response
  10. Print a list in reverse order with range()?
  11. Configuring so that pip install can work from github
  12. Proper way to declare custom exceptions in modern Python?
  13. TypeError: ‘float’ object not iterable
  14. write() versus writelines() and concatenated strings
  15. Why is it string.join(list) instead of list.join(string)?
  16. Importing class from another file [duplicate]
  17. Pandas group-by and sum
  18. Python List vs. Array – when to use?
  19. How to terminate a script?
  20. numpy array concatenate: “ValueError: all the input arrays must have same number of dimensions”
  21. csv.Error: iterator should return strings, not bytes
  22. SyntaxError: non-default argument follows default argument
  23. Remove all special characters, punctuation and spaces from string
  24. AttributeError: ” object has no attribute ”
  25. Plot pie chart and table of pandas dataframe
  26. ModuleNotFoundError: No module named ‘matplotlib’
  27. “inconsistent use of tabs and spaces in indentation”
  28. Pandas ‘count(distinct)’ equivalent
  29. How can I flush the output of the print function?
  30. Python calling method in class
  31. No module named pkg_resources
  32. Opening a .ipynb.txt File
  33. How do I remove all packages installed by PIP?
  34. ValueError: need more than 1 value to unpack python
  35. What is the best way to exit a function (which has no return value) in python before the function ends (e.g. a check fails)?
  36. How to disable Python warnings?
  37. How do I find the distance between two points?
  38. How do I calculate percentiles with python/numpy?
  39. How do I remove a substring from the end of a string?
  40. Selecting with complex criteria from pandas.DataFrame
  41. How can I download Anaconda for python 3.6
  42. django:django.core.exceptions.AppRegistryNotReady: Apps aren’t loaded yet
  43. Replace and overwrite instead of appending
  44. module ‘pandas’ has no attribute ‘rolling_mean’
  45. Displaying better error message than “No JSON object could be decoded”
  46. List attributes of an object [duplicate]
  47. How can I set the aspect ratio in matplotlib?
  48. Using __add__ operator with multiple arguments in Python
  49. How to constantly run Python script in the background on Windows?
  50. Django – “no module named django.core.management”
  51. Type error Unhashable type:set
  52. Saving a Numpy array as an image
  53. TypeError: ‘bool’ object is not callable
  54. Python Subprocess: Too Many Open Files
  55. urllib2.HTTPError: HTTP Error 403: Forbidden
  56. .write not working in Python
  57. Install Plotly in Anaconda
  58. ValueError: zero length field name in format in Python2.6.6
  59. Python NameError, variable ‘not defined’
  60. Cannot import cv2 in python in OSX
  61. numpy-equivalent of list.pop?
  62. How to get row number in dataframe in Pandas?
  63. Difference between Python’s Generators and Iterators
  64. “Unorderable types: int() < str()"
  65. python : an integer is required (got type str)
  66. Django Rest Framework — no module named rest_framework
  67. Unsupported operation :not writeable python
  68. RuntimeError: Invalid DISPLAY variable
  69. Accessing a class’ member variables in Python?
  70. Declaring a multi dimensional dictionary in python
  71. How do I compute derivative using Numpy?
  72. No module named utils error on compiling py file
  73. Convert Pandas Column to DateTime
  74. ImportError: cannot import name NUMPY_MKL
  75. Disable / Enable Button in TKinter
  76. Python: Pandas pd.read_excel giving ImportError: Install xlrd >= 0.9.0 for Excel support
  77. How do I find the time difference between two datetime objects in python?
  78. How to strip a specific word from a string?
  79. Printing subscript in python
  80. Meaning of list[-1] in Python
  81. Tkinter error: Couldn’t recognize data in image file
  82. How to install Openpyxl with pip
  83. getting ZeroDivisionError: integer division or modulo by zero
  84. Iterating through list of list in Python
  85. Installing scipy for python 2.7
  86. Installing MySQL-python causes command ‘clang’ failed with exit status 1 on Mac OS 10.13.15
  87. Get difference between two lists
  88. how to build .exe for python 3.5+, 3.6 if possible?
  89. How to query as GROUP BY in django?
  90. Python regex match space only
  91. OpenCV houghLinesP parameters
  92. What is the most efficient way to store a list in the Django models?
  93. Convert list of dictionaries to a pandas DataFrame
  94. How to read html from a url in python 3
  95. Set variable in jinja
  96. Python how to write to a binary file?
  97. How to download a file via FTP with Python ftplib
  98. How do I restart a program based on user input?
  99. Python Pandas : pivot table with aggfunc = count unique distinct
  100. Flask Value error view function did not return a response [duplicate]

Leave a Comment