Why am I getting “LinAlgError: Singular matrix” from grangercausalitytests?

The problem arises due to the perfect correlation between the two series in your data. From the traceback, you can see, that internally a wald test is used to compute the maximum likelihood estimates for the parameters of the lag-time series. To do this an estimate of the parameters covariance matrix (which is then near-zero) and its inverse is needed (as you can also see in the line invcov = np.linalg.inv(cov_p) in the traceback). This near-zero matrix is now singular for some maximum lag number (>=5) and thus the test crashes. If you add just a little noise to your data, the error disappears:

import numpy as np
import pandas as pd
import matplotlib.pyplot as plt
from statsmodels.tsa.stattools import grangercausalitytests

n = 1000
ls = np.linspace(0, 2*np.pi, n)
df1Clean = pd.DataFrame(np.sin(ls))
df2Clean = pd.DataFrame(2*np.sin(ls+1))
dfClean = pd.concat([df1Clean, df2Clean], axis=1)
dfDirty = dfClean+0.00001*np.random.rand(n, 2)

grangercausalitytests(dfClean, maxlag=20, verbose=False)    # Raises LinAlgError
grangercausalitytests(dfDirty, maxlag=20, verbose=False)    # Runs fine

Related Posts:

  1. Why am I getting “LinAlgError: Singular matrix” from grangercausalitytests?
  2. How to iterate over columns of pandas dataframe to run regression
  3. Building multi-regression model throws error: `Pandas data cast to numpy dtype of object. Check input data with np.asarray(data).`
  4. Remove all whitespace in a string
  5. What is a “method” in Python?
  6. How to generate all permutations of a list?
  7. Is there a Python equivalent to Ruby’s string interpolation?
  8. Python Progress Bar
  9. Most efficient way to find mode in numpy array
  10. Python error “ImportError: No module named”
  11. How to groupby based on two columns in pandas?
  12. How do I append one string to another in Python?
  13. Python Progress Bar
  14. How to correct TypeError: Unicode-objects must be encoded before hashing?
  15. Python: list of lists
  16. How can I split and parse a string in Python?
  17. numpy matrix vector multiplication
  18. whitespace in regular expression
  19. How do I read CSV data into a record array in NumPy?
  20. Basic explanation of python functions
  21. TypeError: ‘Series’ objects are mutable, thus they cannot be hashed problemwith column
  22. How to rename a file using Python
  23. Cosine Similarity between 2 Number Lists
  24. How to install python3 version of package via pip on Ubuntu?
  25. django: TypeError: ‘tuple’ object is not callable
  26. ValueError: Length of values does not match length of index | Pandas DataFrame.unique()
  27. How do I install Python OpenCV through Conda?
  28. How to do superscripts and subscripts in Jupyter Notebook?
  29. How to get a random number between a float range?
  30. Cannot install Beautiful Soup in Anaconda Python 3.6.4 Windows 10
  31. ImportError: cannot import name
  32. How can you profile a Python script?
  33. How to set the current working directory?
  34. heroku: no default language could be detected for this app
  35. ‘DataFrame’ object has no attribute ‘sort’
  36. “VBoxManage not found. Make sure VirtualBox is installed and VBoxManage is in the path”
  37. What is __pycache__?
  38. What does “\r” do in the following script?
  39. How can I remove a key from a Python dictionary?
  40. Add list to set?
  41. Infinite integer in Python
  42. Determine Whether Integer Is Between Two Other Integers?
  43. If vs. else if vs. else statements?
  44. Quoting backslashes in Python string literals
  45. AttributeError: Can only use .dt accessor with datetimelike values
  46. Python string class like StringBuilder in C#?
  47. How do I clear all variables in the middle of a Python script?
  48. How to tell if tensorflow is using gpu acceleration from inside python shell?
  49. What is the easiest way to get current GMT time in Unix timestamp format?
  50. xlrd.biffh.XLRDError: Excel xlsx file; not supported
  51. Python/Json:Expecting property name enclosed in double quotes
  52. Python try-else
  53. How to compare two dates?
  54. Normalize columns of pandas data frame
  55. Python Error: “ValueError: need more than 1 value to unpack”
  56. Python: can’t assign to literal
  57. “Initializing” variables in python?
  58. Difference between except: and except Exception as e:
  59. Flask raises TemplateNotFound error even though template file exists
  60. Python: Declare as integer and character
  61. How to install pytorch in windows?
  62. Python TypeError must be str not int
  63. “Unicode Error “unicodeescape” codec can’t decode bytes… Cannot open text files in Python 3
  64. Pandas join issue: columns overlap but no suffix specified
  65. How to downgrade python from 3.7 to 3.6
  66. Python socket.error: [Errno 111] Connection refused
  67. Windows- Pyinstaller Error “failed to execute script ” When App Clicked
  68. Python: What is the correct MIME type for attaching html file to email
  69. Linear regression with matplotlib / numpy
  70. Solving “500: Internal Server Error, nbconvert failed: xelatex not found in PATH”
  71. Using Look Up Tables in Python
  72. Parallel Python: What is a callback?
  73. python NameError: name ‘file’ is not defined
  74. python BeautifulSoup parsing table
  75. Python Add to dictionary loop
  76. how to exit a python script in an if statement
  77. How to add column to numpy array
  78. OpenCV NoneType object has no attribute shape
  79. AttributeError: ‘str’ object has no attribute ‘items’
  80. ImportError: No module named Crypto.Cipher
  81. Not able to pip install pickle in python 3.6
  82. How to print Unicode character in Python?
  83. Coalesce values from 2 columns into a single column in a pandas dataframe
  84. Convert string to variable name in python
  85. Can not click on a Element: ElementClickInterceptedException in Splinter / Selenium
  86. How to split elements of a list?
  87. How can I find script’s directory?
  88. Porting Perl to Python
  89. Find object in list that has attribute equal to some value (that meets any condition)
  90. What is the purpose of the single underscore “_” variable in Python?
  91. Must have equal len keys and value when setting with an iterable
  92. Syntax highlighting in vim for python
  93. Python IOError: File not open for reading
  94. Strange Exception in Tkinter callback
  95. How to resolve “ImportError: DLL load failed:” on Python?
  96. ‘module’ has no attribute ‘urlencode’
  97. Cannot concatenate ‘str’ and ‘float’ objects?
  98. Python Text Menu Infinite Loop
  99. Install pip for python 3.5
  100. How do I represent and work with n-bit vectors in Python?

Leave a Comment

techhipbettruvabetnorabahisbahis forumutaraftarium24eduseduedueduseduseduedueduedusedus