Create mysql table directly from CSV file using the CSV Storage engine?

I just discovered csvkit, which is a set of Unix command-line tools for CSV files. I installed it on my Mac with pip install csvkit. The command was:

csvsql --dialect mysql --snifflimit 100000 bigdatafile.csv > maketable.sql

You can alternatively provide a DB connection string and it can load the table directly.

Related Posts:

  1. MySQL Error: : ‘Access denied for user ‘root’@’localhost’
  2. MySQL Error: : ‘Access denied for user ‘root’@’localhost’
  3. Case statement in MySQL
  4. Error Code: 2013. Lost connection to MySQL server during query
  5. how to drop partition without dropping data in MySQL?
  6. MySQL equivalent of DECODE function in Oracle
  7. importing a CSV into phpmyadmin
  8. How to map data on CSV to web pages?
  9. MySQL create table if not exists and insert record only if table was created
  10. getting error HTTP Status 405 – HTTP method GET is not supported by this URL but not used `get` ever?
  11. Why do we need “Relationships” between tables at all?
  12. How to declare a variable in MySQL?
  13. Export Pervasive to MySQL (C#)
  14. MySQL SELECT increment counter
  15. How to get size of mysql database?
  16. Simple way to calculate median with MySQL
  17. Creating a search form in PHP to search a database?
  18. The ALTER TABLE statement conflicted with the FOREIGN KEY constraint
  19. Error 1046 No database Selected, how to resolve?
  20. What is it exactly a BLOB in a DBMS context
  21. Simulate CREATE DATABASE IF NOT EXISTS for PostgreSQL?
  22. MySQL – UPDATE multiple rows with different values in one query
  23. How to create a MySQL hierarchical recursive query?
  24. PHP Warning: mysql_num_rows() expects parameter 1 to be resource, boolean given in /home/website/public_html/facebook/fbclogin.php on line 57 [duplicate]
  25. MySQL LIKE IN()?
  26. WordPress site migration – icons missing
  27. Using wpdb to connect to a separate database
  28. WordPress (MyISAM) database is slow, should I switch to InnoDB?
  29. WordPress Database lost auto increment
  30. Slow wp_term_relationships query
  31. How to use “TRUNCATE TABLE” MySQL statement?
  32. Slow SQL_CALC_FOUND_ROWS Query
  33. How is the data stored in the database?
  34. How do I write this SQL statement for Posts written in last 24 hours?
  35. Would manually deleting the dumping data fix a “#1062 – Duplicate entry ‘1’ for key ‘PRIMARY'” phpMyAdmin error?
  36. WooCommerce – Query for ordered products
  37. How to find if a post with custom_field == X exists?
  38. Import 10,000 Users into WordPress WITH a specific ID for each user
  39. WP database error for comments_popup_link()
  40. Query WordPress database by registered date and role
  41. Tons of Twitter rows in my database
  42. Set Display Name to first and last name (phpmyadmin SQL Query)
  43. Manually removing revision post types
  44. Select Multiple meta_value from WP DB; Single Query
  45. Within the database, where is the flag which says that a user has Super Admin rights?
  46. Is it possible to split database tables using HyperDB?
  47. Order by custom table and multiplication
  48. What happens if I overwrite the current wp_options table with a backup from a week ago?
  49. SQL Error wp_commentmeta – incorrect table definition
  50. WordPress database error – Error in SQL syntax – I can’t identify any error?
  51. CRUD operations using WordPress database API
  52. WordPress database error for query INSERT INTO
  53. How to connect to AWS RDS external database (not for the core WordPress db)
  54. Database Tables Lost Indexes? How to Recover?
  55. How to Mirror WordPress database from Remote server to Local server
  56. Is MariaDB’s Aria storage engine suitable for WordPress?
  57. Slow queries constantly getting stuck on WordPress database of ~100,000 posts
  58. How do I query wp_options for expired transient pairs with MySQL commands?
  59. Automatic switch to backup database on fail
  60. WordPress running SQL query to update database from form
  61. How to fix database error duplicate entry
  62. How do I convert a MySQL database from utf8mb4 to utf8 encoding?
  63. Alternative functions for mysql_free_result and mysql_ping in wordpress functions
  64. Custom WordPress Table wpdb
  65. Why this query is not showing any result on wordpresss home page?
  66. Best practice to limit results in get_row()?
  67. Trouble running $wpdb->query() with last_insert_id
  68. how to encyrpt DB_PASSWORD in wp-config
  69. Undo WooCommerce CSV import
  70. External wpdb connections in different plugins on single page
  71. WP_Query with page_ids in arguments without a result
  72. wp_usermeta – Read from database, but save function broken
  73. How to get product order by two custom taxonomy in wordpress
  74. Adding data to custom wordpress database table
  75. Add row to custom database Table and delete all rows older than 1 day
  76. Having problem creating local instance of wordpress site
  77. select a single val though a table in wordpress
  78. Integrating Custom Database with WordPress
  79. WordPress database error: [Query was empty] – using $wpdb->prepare()
  80. Please help! I have a problem with getting wordpress databas
  81. Why last row deleted when refresh page
  82. Bulk find & replace on WordPress posts/pages (minus image paths)
  83. WordPress database problem wp_posts, primary key
  84. How to import products in host instead of database on wordpress?
  85. I would like some help wth an SQL query to link posts with categories
  86. Merging development site with live site
  87. The MySQL Connection could not be established., before it was joomla but i have change it into worpress
  88. Missing latest posts and options after DB migration via phpMyAdmin
  89. How to set max users to 17.000
  90. live site do not update after importing sql database
  91. How do i get value from wp_postmeta?
  92. Function to get the name in database table from the comma separated string
  93. “MySQL server has gone away” since update to 3.8
  94. featured image not showing up with mysql_connect
  95. Print output of Table Creation
  96. SQL Query to get post_id from wp_posts and and meta_key(s) from wp_postmeta
  97. How can I delete the options from DB when the plugin is deleted?
  98. SQL query into to WP query
  99. How to find fresh (last modified) and sql backup?
  100. Putting form result in my database

Leave a Comment

tech