Can I set max_retries for requests.request?

It is the underlying urllib3 library that does the retrying. To set a different maximum retry count, use alternative transport adapters:

from requests.adapters import HTTPAdapter

s = requests.Session()
s.mount('http://stackoverflow.com', HTTPAdapter(max_retries=5))

The max_retries argument takes an integer or a Retry() object; the latter gives you fine-grained control over what kinds of failures are retried (an integer value is turned into a Retry() instance which only handles connection failures; errors after a connection is made are by default not handled as these could lead to side-effects).

Old answer, predating the release of requests 1.2.1:

The requests library doesn’t really make this configurable, nor does it intend to (see this pull request). Currently (requests 1.1), the retries count is set to 0. If you really want to set it to a higher value, you’ll have to set this globally:

import requests

requests.adapters.DEFAULT_RETRIES = 5

This constant is not documented; use it at your own peril as future releases could change how this is handled.

Update: and this did change; in version 1.2.1 the option to set the max_retries parameter on the HTTPAdapter() class was added, so that now you have to use alternative transport adapters, see above. The monkey-patch approach no longer works, unless you also patch the HTTPAdapter.__init__() defaults (very much not recommended).

Related Posts:

  1. ImportError: No module named requests
  2. Importing requests module does not work
  3. How to POST JSON data with Python Requests?
  4. Max retries exceeded with URL in requests
  5. Using headers with the Python requests library’s get method
  6. Using headers with the Python requests library’s get method
  7. ImportError: No module named ‘Queue’
  8. Download large file in python with requests
  9. Getting with Python http requests instead of INT
  10. How to use cookies in Python Requests
  11. Python Requests – No connection adapters
  12. Unable to resolve ‘requests’. IntelliSense may be missing for this module. Visual Studio/Python
  13. Python requests SSL error – certificate verify failed
  14. How do I sort a dictionary by value?
  15. TypeError: only size-1 arrays can be converted to Python scalars (matplotlib)
  16. Why do I get TypeError: can’t multiply sequence by non-int of type ‘float’?
  17. Writing a pandas DataFrame to CSV file
  18. Is there a label/goto in Python?
  19. Why do I get “Pickle – EOFError: Ran out of input” reading an empty file?
  20. Getting TypeError: __init__() missing 1 required positional argument: ‘on_delete’ when trying to add parent table after child table with entries
  21. Python Pandas Counting the Occurrences of a Specific value
  22. What does the c underscore expression `c_` do exactly?
  23. Count unique values per groups with Pandas
  24. Get unique values from a list in python [duplicate]
  25. How do you decode Base64 data in Python?
  26. Convert pandas Series to DataFrame
  27. TypeError: ‘type’ object is not subscriptable when indexing in to a dictionary
  28. Error: all the input array dimensions except for the concatenation axis must match exactly
  29. Expected 2D array, got 1D array instead error
  30. How to prevent errno 32 broken pipe?
  31. The equivalent of a GOTO in python [duplicate]
  32. tkinter gui with progress bar
  33. Invalid character in identifier
  34. if else in a list comprehension
  35. What does “\r” do in the following script?
  36. Convert list to tuple in Python
  37. Python: TypeError: object of type ‘NoneType’ has no len()
  38. Tkinter understanding mainloop
  39. Embedding in pytorch
  40. Check string “None” or “not” in Python 2.7
  41. re.search().TypeError: cannot use a string pattern on a bytes-like object
  42. Cannot uninstall Tensorflow
  43. Add Legend to Seaborn point plot
  44. Get key by value in dictionary
  45. How to add multiple values to a dictionary key in python?
  46. Where can I find a list of the Flask SQLAlchemy Column types and options?
  47. How can I install Python’s pip3 on my Mac?
  48. convert json ipython notebook(.ipynb) to .py file
  49. how to update spyder on anaconda
  50. Django upgrading to 1.9 error “AppRegistryNotReady: Apps aren’t loaded yet.”
  51. Pygame Drawing a Rectangle
  52. Convert a Pandas DataFrame to a dictionary
  53. Python: Write array values into file
  54. use np.random.multinomial() in python
  55. pg_config executable not found
  56. Import error when trying to import tensorflow with gpu
  57. Removing Punctuation From Python List Items
  58. TypeError(“‘bool’ object is not iterable”,) when trying to return a Boolean
  59. “OverflowError: Python int too large to convert to C long” on windows but not mac
  60. Create a Pandas Dataframe by appending one row at a time
  61. ‘Pip’ is Not Recognized as an Internal or External Command windows 10 CMD
  62. Failed to load the native TensorFlow runtime – TensorFlow 2.1
  63. How to unnest a nested list
  64. How to sort a list/tuple of lists/tuples by the element at a given index?
  65. What can lead to “IOError: [Errno 9] Bad file descriptor” during os.system()?
  66. Shebang doesn’t work with python3
  67. How to get a value from a cell of a dataframe?
  68. TypeError: can only concatenate str (not “float”) to str
  69. Converting a sentence to piglatin in Python
  70. How to use pygame.KEYDOWN to execute something every time through a loop while the key is held down?
  71. How to create an integer array in Python?
  72. Recursion in Python? RuntimeError: maximum recursion depth exceeded while calling a Python object
  73. Writing a dictionary to a csv file with one line for every ‘key: value’
  74. How to remove square brackets from list in Python?
  75. Errno 10061 : No connection could be made because the target machine actively refused it ( client – server )
  76. Python Error – TypeError: input expected at most 1 arguments, got 3 [duplicate]
  77. A general tree implementation?
  78. TypeError: expected string or buffer
  79. How to convert a file into a dictionary?
  80. Checking to see if a string is an integer or float
  81. Getting the name of a variable as a string
  82. can’t multiply sequence by non-int of type ‘list’
  83. cannot convert the series to
  84. Converting a RGB color tuple to a six digit code
  85. Simple way to create matrix of random numbers
  86. pandas: multiple conditions while indexing data frame – unexpected behavior
  87. ‘instancemethod’ object has no attribute ‘__getitem__’ with class variables
  88. Python/Scikit-Learn – Can’t handle mix of multiclass and continuous
  89. Sorting list of lists by the first element of each sub-list
  90. Install py2exe for python 2.7 over pip: this package requires Python 3.3 or later
  91. What is the correct format to write float value to file in Python
  92. How is Python’s List Implemented?
  93. Find all files in a directory with extension .txt in Python
  94. “public” or “private” attribute in Python ? What is the best way?
  95. How to search for a string in text files?
  96. TypeError: ‘zip’ object is not subscriptable
  97. Pip: could not find a version. No matching distribution found
  98. Compare two columns using pandas
  99. ValueError: total size of new array must be unchanged
  100. Shuffle an array with python, randomize array item order with python

Leave a Comment