n-grams in python, four, five, six grams?

Great native python based answers given by other users. But here’s the nltk approach (just in case, the OP gets penalized for reinventing what’s already existing in the nltk library).

There is an ngram module that people seldom use in nltk. It’s not because it’s hard to read ngrams, but training a model base on ngrams where n > 3 will result in much data sparsity.

from nltk import ngrams

sentence = 'this is a foo bar sentences and i want to ngramize it'

n = 6
sixgrams = ngrams(sentence.split(), n)

for grams in sixgrams:
  print grams

Related Posts:

  1. working of \n in python [duplicate]
  2. How to remove punctuation in python?
  3. Python: TypeError: cannot concatenate ‘str’ and ‘int’ objects
  4. How to get the filename without the extension from a path in Python?
  5. sprintf like functionality in Python
  6. Alphabet range in Python
  7. How do I lowercase a string in Python?
  8. How do I get a substring of a string in Python?
  9. Changing one character in a string
  10. How to read a file line-by-line into a list?
  11. What is lexicographical order?
  12. strip(char) on a string
  13. How to convert list to string [duplicate]
  14. Converting integer to string in Python
  15. Reverse a string in Python
  16. Regex not operator
  17. Print string to text file
  18. Best way to convert string to bytes in Python 3?
  19. Does Python have a string ‘contains’ substring method?
  20. Extract substring in Bash
  21. How do I append one string to another in Python?
  22. How can I split and parse a string in Python?
  23. How to read a text file into a string variable and strip newlines?
  24. How to print like printf in Python3?
  25. string to string array conversion in java
  26. What is the difference between \r\n, \r, and \n? [duplicate]
  27. Python convert tuple to string
  28. write() versus writelines() and concatenated strings
  29. Why is it string.join(list) instead of list.join(string)?
  30. Why is it string.join(list) instead of list.join(string)?
  31. Best way to strip punctuation from a string
  32. Split string with multiple delimiters in Python [duplicate]
  33. How to check if the string is empty?
  34. How to find all occurrences of a substring?
  35. What is the difference between a “line feed” and a “carriage return”?
  36. How to convert an int to string in C?
  37. How to check whether a str(variable) is empty or not?
  38. What does the ‘b’ character do in front of a string literal?
  39. How to add a string in a certain position?
  40. Check string “None” or “not” in Python 2.7
  41. Remove all special characters, punctuation and spaces from string
  42. This can be done without regex:
  43. How to replace all double quotes to single quotes using jquery?
  44. Pythonic way to create a long multi-line string
  45. Generate random string/characters in JavaScript
  46. “[ ]” vs. “[[ ]]” in Bash shell
  47. How to delete a character from a string using Python
  48. Python: Get the first character of the first string in a list?
  49. How to trim whitespace from a Bash variable?
  50. How to convert string to binary?
  51. Convert hex to binary
  52. Quoting backslashes in Python string literals
  53. Python string class like StringBuilder in C#?
  54. C – The %x format specifier
  55. Best way to replace multiple characters in a string?
  56. How do I remove a substring from the end of a string?
  57. Detect whether a Python string is a number or a letter
  58. Finding all possible permutations of a given string in python
  59. How do I append one string to another in Python?
  60. AttributeError: ‘list’ object has no attribute ‘replace’ when trying to remove character
  61. AttributeError: ‘list’ object has no attribute ‘replace’ when trying to remove character
  62. How to convert string to binary?
  63. Converting from a string to boolean in Python?
  64. Count the number of occurrences of a character in a string
  65. What is the difference between ‘ and ” in JavaScript?
  66. \n or \n in php echo not print [duplicate]
  67. bash : Bad Substitution
  68. Convert hex string to int in Python
  69. How can I check if character in a string is a letter? (Python)
  70. How can I find the first occurrence of a sub-string in a python string?
  71. Replacing a character from a certain index
  72. AttributeError: ‘list’ object has no attribute ‘lower’ gensim
  73. How to assign multiple lines string in Powershell Console
  74. Pandas error “Can only use .str accessor with string values”
  75. LC-3 STR with R1 as offset
  76. Convert a Unicode string to a string in Python (containing extra symbols)python string unicode type-conversion
  77. Create nice column output in python
  78. TypeError: decoding str is not supported
  79. AttributeError: ‘str’ object has no attribute ‘items’
  80. Python can’t find module NLTK
  81. How to pad zeroes to a string?
  82. How does str(list) work?
  83. What is the difference between a string and a byte string?
  84. How to strip a specific word from a string?
  85. Checking if a string can be converted to float in Python
  86. Passing string to a function in C – with or without pointers?
  87. Python cant convert ‘list’ object to str error [closed]
  88. Difference between char* and char** (in C)
  89. Using strip() to clean up a string
  90. Extract filename and extension in Bash
  91. Meaning of #{ } in Ruby?
  92. Python code to remove HTML tags from a string 
  93. How to use Stanford Parser in NLTK using Python
  94. Cannot concatenate ‘str’ and ‘float’ objects?
  95. How to repeat individual characters in strings in Python
  96. Taking a new line using printf in java? Is %n correct?
  97. When to use %r instead of %s in Python? [duplicate]
  98. str.translate gives TypeError – Translate takes one argument (2 given), worked in Python 2
  99. How to count instances of character in SQL Column
  100. Python – difference between two strings

Leave a Comment