How to solve UnicodeDecodeError: ‘utf-8’ codec can’t decode byte 0xff in position 0: invalid start byte in python

There is a Python library which may help when the encoding is unknown: chardet

with open(filename, 'rb') as file:
    print(chardet.detect(file.read()))

detect finds the encoding, and ‘rb’ will read the file in as binary

Related Posts:

  1. ValueError: Unknown label type: ‘continuous’
  2. Transpose/Unzip Function (inverse of zip)?
  3. TypeError: unhashable type: ‘numpy.ndarray’
  4. python base64 to hex
  5. What’s the canonical way to check for type in Python?
  6. IndexError: tuple index out of range —– Python
  7. What is the pythonic way to calculate dot product?
  8. How to resize an image with OpenCV2.0 and Python2.6
  9. Is there a ‘foreach’ function in Python 3?
  10. How to condense if/else into one line in Python?
  11. Depth-first search (DFS) code in python
  12. How to use Python to execute a cURL command?
  13. How can I remove a trailing newline?
  14. ImportError: cannot import name main when running pip –version command in windows7 32 bit
  15. pygame.error: video system not initialized
  16. How to draw a circle in PyGame?
  17. TypeError: ‘numpy.float64’ object is not callable?
  18. Why do I get: “Length of values does not match length of index” error?
  19. How to remove all the punctuation in a string? (Python)
  20. Cross Entropy in PyTorch
  21. How to import the class within the same directory or sub directory?
  22. why should I make a copy of a data frame in pandas
  23. How to create a new text file using Python
  24. How to normalize a NumPy array to a unit vector?
  25. What does & mean in python
  26. how do you check your django version in cmd
  27. Pandas, merging two dataframes on multiple columns, and multiplying result
  28. Are dictionaries ordered in Python 3.6+?
  29. How to customize a scatter matrix to see all titles?
  30. Return JSON response from Flask view
  31. Convert hex to binary
  32. TypeError: ‘encoding’ is an invalid keyword argument for this function
  33. How to calculate a logistic sigmoid function in Python?
  34. Why is python setup.py saying invalid command ‘bdist_wheel’ on Travis CI?
  35. How to write bytes to file?
  36. PyLint “Unable to import” error – how to set PYTHONPATH?
  37. ImportError: No module named scipy
  38. What is the Python 3 equivalent of “python -m SimpleHTTPServer”
  39. What does -> mean in Python function definitions?
  40. Forbidden (403) CSRF verification failed. Request aborted. Even using the {% csrf_token %}
  41. Flask ImportError: No Module Named Flask
  42. (unicode error) ‘unicodeescape’ codec can’t decode bytes in position 2-3: truncated \UXXXXXXXX escape
  43. How do you split a list into evenly sized chunks?
  44. Ignoring NaNs with str.containsv
  45. How to split a string into a list of characters in Python?
  46. Find where python is installed (if it isn’t default dir)
  47. log2 in python math module
  48. python ZeroDivisionError: float division by zero – how to treat it as an exception
  49. Unresolved reference issue in PyCharm
  50. How to use 2to3 properly for python?
  51. Is there a way to return literally nothing in python?
  52. Is there a built-in function to print all the current properties and values of an object?
  53. How to troubleshoot an “AttributeError: __exit__” in multiproccesing in Python?
  54. TypeError : Unhashable type
  55. No module named googlesamples.assistant.auth_helpers
  56. Solution for SpecificationError: nested renamer is not supported while agg() along with groupby()
  57. Why is there no tuple comprehension in Python?
  58. pip: no module named _internal
  59. Image.open() cannot identify image file – Python?
  60. python socket programming OSError: [WinError 10038] an operation was attempted on something that is not a socket
  61. Multiple try codes in one block
  62. Error: Segmentation fault (core dumped)
  63. Error “‘type’ object has no attribute ‘__getitem__'” when iterating over list[“a”,”b”,”c”]
  64. Python: “TypeError: __str__ returned non-string” but still prints to output?
  65. ImportError: No module named ‘django.core.urlresolvers’
  66. Numpy, multiply array with scalar
  67. Python 3: Multiply a vector by a matrix without NumPy
  68. How to fix “Can’t find a default Python” error
  69. TypeError: ‘newline’ is an invalid keyword argument for this function
  70. datetime to string with series in pandas
  71. Is it possible only to declare a variable without assigning any value in Python?
  72. How to Install pip for python 3.7 on Ubuntu 18?
  73. How to add a new row to an empty numpy array
  74. Logical indexing with lists
  75. How do I access my webcam in Python?
  76. Boolean Series key will be reindexed to match DataFrame index
  77. What is the easiest way to clear a database from the CLI with manage.py in Django?
  78. Printing one character at a time from a string, using the while loop
  79. Change the name of a key in dictionary
  80. Check if an object exists
  81. How do I calculate the date six months from the current date using the datetime Python module?
  82. How to embed image or picture in jupyter notebook, either from a local machine or from a web resource?
  83. How to make a python script wait for a pressed key?
  84. TypeError: Image data can not convert to float
  85. Mean Squared Error in Numpy?
  86. Turn a single number into single digits Python
  87. Is there a head and tail method for Numpy array?
  88. Write a program using integers user_num and x as input, and output user_num divided by x three times
  89. Logical operators for Boolean indexing in Pandas
  90. Transposing a 1D NumPy array
  91. Explaining Python’s ‘__enter__’ and ‘__exit__’
  92. numpy.float64 object is not iterable…but I’m NOT trying to
  93. Converting a list to a set changes element order
  94. Create a list with initial capacity in Python
  95. Accessing dict_keys element by index in Python3
  96. How to update Pandas from Anaconda and is it possible to use eclipse with this last
  97. Does python support character type?
  98. Styling multi-line conditions in ‘if’ statements?
  99. What is related_name used for?
  100. Symbol not found: __PyCodecInfo_GetIncrementalDecoder

Leave a Comment