Running Selenium with Headless Chrome Webdriver

To run chrome-headless just add --headless via chrome_options.add_argument, i.e.:

from selenium import webdriver 
from selenium.webdriver.chrome.options import Options
chrome_options = Options()
#chrome_options.add_argument("--disable-extensions")
#chrome_options.add_argument("--disable-gpu")
#chrome_options.add_argument("--no-sandbox") # linux only
chrome_options.add_argument("--headless")
# chrome_options.headless = True # also works
driver = webdriver.Chrome(options=chrome_options)
start_url = "https://duckgo.com"
driver.get(start_url)
print(driver.page_source.encode("utf-8"))
driver.quit()
# b'<!DOCTYPE html><html xmlns="http://www....

So my thought is that running it with headless chrome would make my script faster.

Try using chrome options like --disable-extensions or --disable-gpu and benchmark it, but I wouldn’t count with much improvement.

References: headless-chrome

Note: As of today, when running chrome headless on Windows., you should include the  --disable-gpu flag See crbug.com/737678

Related Posts:

  1. SBOX_FATAL_MEMORY_EXCEEDED error shown when Chromedriver turned 1800-1900 pages using Selenium
  2. selenium – chromedriver executable needs to be in PATH
  3. Jupyter Notebook not saving: ‘_xsrf’ argument missing from post
  4. Jupyter Notebook not saving: ‘_xsrf’ argument missing from post
  5. Selenium using Python – Geckodriver executable needs to be in PATH
  6. Wait until page is loaded with Selenium WebDriver for Python
  7. How to select a drop-down menu value with Selenium using Python?
  8. Can not click on a Element: ElementClickInterceptedException in Splinter / Selenium
  9. Selenium “Unable to find a matching set of capabilities” despite driver being in /usr/local/bin
  10. ElementClickInterceptedException: element click intercepted:
  11. SessionNotCreatedException: Message: session not created: This version of ChromeDriver only supports Chrome version 81
  12. Purpose of “%matplotlib inline”
  13. How do I update Anaconda?
  14. TypeError: ‘str’ object is not callable (Python)
  15. Dijkstra’s algorithm in python
  16. How to create a GUID/UUID in Python
  17. Replace ‘ with \’ in a string
  18. How can I install pip on Windows?
  19. Best way to convert string to bytes in Python 3?
  20. Does Python have a string ‘contains’ substring method?
  21. Difference between import numpy and import numpy as np
  22. No module named ‘sklearn.cross_validation’
  23. Arrays used as indices must be of integer (or boolean) type
  24. Are static class variables possible in Python?
  25. Why am I getting “LinAlgError: Singular matrix” from grangercausalitytests?
  26. ‘method’ object is not subscriptable. Don’t know what’s wrong
  27. How do I copy a file in Python?
  28. EOFError: Ran out of input
  29. Get Color Palettes from ColorHunt.co in Python
  30. What does the Pydoc module do?
  31. size of NumPy array
  32. Best way to strip punctuation from a string
  33. How can I explicitly free memory in Python?
  34. filename.whl is not supported wheel on this platform
  35. What is the meaning of [:] in python [duplicate]
  36. Finding and replacing elements in a list
  37. socket.error: [Errno 48] Address already in use
  38. How to determine a Python variable’s type?
  39. Could not find a version that satisfies the requirement
  40. Removing Conda environment
  41. Cannot convert list to array: ValueError: only one element tensors can be converted to Python scalars
  42. How do I plot only a table in Matplotlib?
  43. Change column type in pandas
  44. Split by comma and strip whitespace in Python
  45. How to remove punctuation marks from a string in Python 3.x using .translate()?
  46. Calculating Covariance with Python and Numpy
  47. What is the easiest way to remove all packages installed by pip?
  48. In practice, what are the main uses for the new “yield from” syntax in Python 3.3?
  49. Subplot for seaborn boxplot
  50. Dump a NumPy array into a csv file
  51. Add a new item to a dictionary in Python
  52. reducing number of plot ticks
  53. How can I add new keys to a dictionary?
  54. Convert pandas data frame to series
  55. Decorators with parameters?
  56. How do I get a python program to do nothing?
  57. inserting characters at the start and end of a string
  58. How can I install Python’s pip3 on my Mac?
  59. Error handling in Python-MySQL
  60. List files ONLY in the current directory
  61. No Module Named ‘_pywrap_tensorflow_internal’
  62. Append a tuple to a list – what’s the difference between two ways?
  63. No module named Image
  64. How to fix “TypeError: len() of unsized object”
  65. ValueError: Unknown projection ‘3d’ (once again)
  66. Difference between len() and .__len__()?
  67. Python: AttributeError: ‘_io.TextIOWrapper’ object has no attribute ‘split’
  68. How to detect key presses?
  69. isPrime Function for Python Language
  70. Python script to copy text to clipboard
  71. How can I check if character in a string is a letter? (Python)
  72. OSError: Initializing from file failed on csv in Pandas
  73. When running WebDriver with Chrome browser, getting message, “Only local connections are allowed” even though browser launches properly
  74. TypeError: unsupported format string passed to list.__format__
  75. Getting “socket.error: [Errno 61] Connection refused” python paramiko
  76. python setup.py uninstall
  77. ImportError: No module named cv2
  78. ./xx.py: line 1: import: command not found
  79. How to open every file in a folder
  80. Python iteration over non-sequence
  81. How do I convert a string to a double in Python?
  82. _csv.Error: field larger than field limit (131072)
  83. How do I rotate an image around its center using Pygame?
  84. How can I copy a Python string?
  85. Issue with virtualenv – cannot activate
  86. Can I set max_retries for requests.request?
  87. Why do I get this error “TypeError: ‘method’ object is not iterable”?
  88. Are nested try/except blocks in Python a good programming practice?
  89. Getting a name error when trying to input a string [duplicate]
  90. Complex number troubles with numpy
  91. Running shell command and capturing the output
  92. Package libffi was not found in the pkg-config search path REDHAT6.5
  93. Line is too long. Django PEP8
  94. TypeError: zip argument #2 must support iteration
  95. CS231n: How to calculate gradient for Softmax loss function?
  96. How to create a new database using SQLAlchemy?
  97. Python 3 integer division [duplicate]
  98. numpy/scipy/ipython:Failed to interpret file as a pickle
  99. What is the Python equivalent of static variables inside a function?
  100. Python – difference between two strings

Leave a Comment