The csv file might contain very huge fields, therefore increase the field_size_limit
:
import sys import csv csv.field_size_limit(sys.maxsize)
sys.maxsize
works for Python 2.x and 3.x. sys.maxint
would only work with Python 2.x (SO: what-is-sys-maxint-in-python-3)
Update
As Geoff pointed out, the code above might result in the following error: OverflowError: Python int too large to convert to C long
. To circumvent this, you could use the following quick and dirty code (which should work on every system with Python 2 and Python 3):
import sys import csv maxInt = sys.maxsize while True: # decrease the maxInt value by factor 10 # as long as the OverflowError occurs. try: csv.field_size_limit(maxInt) break except OverflowError: maxInt = int(maxInt/10)