Removing nan values from an array

If you’re using numpy for your arrays, you can also use

x = x[numpy.logical_not(numpy.isnan(x))]

Equivalently

x = x[~numpy.isnan(x)]

[Thanks to chbrown for the added shorthand]

Explanation

The inner function, numpy.isnan returns a boolean/logical array which has the value True everywhere that x is not-a-number. As we want the opposite, we use the logical-not operator, ~ to get an array with Trues everywhere that x is a valid number.

Lastly we use this logical array to index into the original array x, to retrieve just the non-NaN values.

Related Posts:

  1. ValueError: setting an array element with a sequence
  2. Numpy ValueError: setting an array element with a sequence. This message may appear without the existing of a sequence?
  3. numpy: Invalid value encountered in true_divide
  4. How do I create an empty array/matrix in NumPy?
  5. numpy matrix vector multiplication
  6. Convert pandas dataframe to NumPy array
  7. size of NumPy array
  8. ValueError: all the input arrays must have same number of dimensions
  9. ValueError: setting an array element with a sequence
  10. Using Numpy Vectorize on Functions that Return Vectors
  11. convert nan value to zero
  12. Is there a NumPy function to return the first index of something in an array?
  13. Numpy/Python Array Value error
  14. initialize a numpy array
  15. load csv into 2D matrix with numpy for plotting
  16. How to access the ith column of a NumPy multidimensional array?
  17. Dump a NumPy array into a csv file
  18. Python: find position of element in array
  19. numpy with python: convert 3d array to 2d
  20. Python: slicing a multi-dimensional array
  21. How to remove specific elements in a numpy array
  22. Add single element to array in numpy
  23. How to normalize a 2-dimensional numpy array in python less verbose?
  24. Make list of arrays in python
  25. Understanding NumPy’s einsum
  26. How to fix “TypeError: len() of unsized object”
  27. TypeError: Invalid dimensions for image data when plotting array with imshow()
  28. Numpy.dot TypeError: Cannot cast array data from dtype(‘float64’) to dtype(‘S32’) according to the rule ‘safe’
  29. How to get the unit vector from a numpy array
  30. numpy-equivalent of list.pop?
  31. Using numpy to build an array of all combinations of two arrays
  32. Efficiently sorting a numpy array in descending order?
  33. How to plot an array in python?
  34. TypeError: only integer arrays with one element can be converted to an index 3
  35. How to create a numpy array of all True or all False?
  36. How to create a numpy array of lists?
  37. Root mean square of a function in python
  38. What are the differences between numpy arrays and matrices? Which one should I use?
  39. Numpy – add row to array
  40. Is there any numpy group by function?
  41. Mean Squared Error in Numpy?
  42. How to normalize a NumPy array to within a certain range?
  43. numpy array concatenation error: 0-d arrays can’t be concatenated
  44. Convert a 1D array to a 2D array in numpy
  45. inverting image in Python with OpenCV
  46. How to print the full NumPy array, without truncation?
  47. Sorting arrays in NumPy by column
  48. How to declare an array in Python?
  49. TypeError: only integer scalar arrays can be converted to a scalar index with 1D numpy indices array
  50. Import Error: No module named numpy
  51. numpy max vs amax vs maximum
  52. What is the purpose of meshgrid in Python / NumPy?
  53. why numpy.ndarray is object is not callable in my simple for python loop
  54. numpy division with RuntimeWarning: invalid value encountered in double_scalars
  55. Most efficient way to find mode in numpy array
  56. How do I read CSV data into a record array in NumPy?
  57. How to replace NaN values by Zeroes in a column of a Pandas Dataframe?
  58. How do I read CSV data into a record array in NumPy?
  59. How to normalize a NumPy array to a unit vector?
  60. ImportError: numpy.core.multiarray failed to import
  61. ImportError: numpy.core.multiarray failed to import
  62. Python List vs. Array – when to use?
  63. numpy array concatenate: “ValueError: all the input arrays must have same number of dimensions”
  64. ‘DataFrame’ object has no attribute ‘sort’
  65. Is arr.__len__() the preferred way to get the length of an array in Python?
  66. Most efficient way to map function over numpy array
  67. TypeError: ‘DataFrame’ object is not callable
  68. LinAlgError: Last 2 dimensions of the array must be square
  69. What does axis in pandas mean?
  70. How do I get an empty array of any size in python?
  71. TypeError: list indices must be integers or slices, not str
  72. 3-dimensional array in numpy
  73. How do I calculate percentiles with python/numpy?
  74. How to have an array of arrays in Python
  75. ‘list’ object has no attribute ‘shape’
  76. What is the difference between np.mean and tf.reduce_mean?
  77. What does ‘index 0 is out of bounds for axis 0 with size 0’ mean?
  78. What does ‘index 0 is out of bounds for axis 0 with size 0’ mean?
  79. pandas create new column based on values from other columns / apply a function of multiple columns, row-wise
  80. Moving average or running mean
  81. ValueError: x and y must be the same size
  82. Saving a Numpy array as an image
  83. NumPy List Comprehension Syntax
  84. Linear regression with matplotlib / numpy
  85. Numpy extract submatrix
  86. pandas DataFrame: replace nan values with average of columns
  87. RuntimeError: module compiled against API version a but this version of numpy is 9
  88. Python: Can a function return an array and a variable?
  89. Matplotlib: TypeError: can’t multiply sequence by non-int of type ‘numpy.float64’
  90. How to add column to numpy array
  91. How to fix ‘RuntimeWarning: divide by zero encountered in double_scalars’
  92. IndexError: index 2 is out of bounds for axis 0 with size 2
  93. Coalesce values from 2 columns into a single column in a pandas dataframe
  94. Compute a confidence interval from sample data
  95. Create numpy matrix filled with NaNs
  96. How do I compute derivative using Numpy?
  97. ImportError: cannot import name NUMPY_MKL
  98. built-in range or numpy.arange: which is more efficient?
  99. Calculate weighted average using a pandas/dataframe
  100. TypeError: zip argument #2 must support iteration

Leave a Comment