Best way to store 1 billion+ posts?

I don’t know about how long it will take to create that many tables, especially if you do it in one go, but you can use $wpdb to handle the creation. There’s an article on the Codex regarding creating custom tables, https://codex.wordpress.org/Creating_Tables_with_Plugins

And it crossed my mind that perhaps using some external tool to handle the database querying could potentially make the queries run faster. Elasticsearch (I’m not an affiliate), in tandem with ElasticPress, is the only one I’ve heard of, but I’m sure there’s plenty of similar tools. Maybe that could be worth checking out?

Related Posts:

  1. WordPress database scalability from the code perspective
  2. Performance tips for a large user base [closed]
  3. WP_Options ID high
  4. WordPress for a very large website
  5. WordPress database becoming huge. How to analyze and optimize it? fear of running out of memory
  6. Improve or optimize a very slow query
  7. WooCommerce with thousands of products – site is very slow – optimize db queries? [closed]
  8. Efficiency on displaying random authors based on large database
  9. How to solve slow WordPress site caused by attachment_metadata
  10. Relationship between performance and database size
  11. Database slowdown after update to 3.4.1
  12. wp_redirection_404 table has grown to 7GB
  13. Which is more efficient? Using usermeta, or creating a new MySQL table?
  14. One post carries 30 postmeta values, is this too much?
  15. Multiple wp_options tables to share content across installs
  16. Improve performance by removing unnecessary database queries
  17. fastest replacement DB
  18. How to prevent/delay MySQL connections when an object cache is used?
  19. Does auto_load to ‘no’ in wp_options improve performance
  20. How to combine multiple wp_insert_post into one in order to gain better performance
  21. Optimizing function that automatically creates internal links based on post title string
  22. Is there anyway to split posts to different databases?
  23. Job and Employee Performance Tracking with Product Safety
  24. What structure and database storage method should I use for temporary storage that may be written concurrently?
  25. Get all top categories, then only 3 posts for each
  26. Optimize WP site for millions of posts
  27. Counting user’s comments – efficient way?
  28. Performance bug – slow DB query
  29. Mysql Queries per Visit – Crazy High
  30. Is it fine to have foreign key as primary key?
  31. Delete all posts of a custom post type—efficiently
  32. Detecting errors generated by $wpdb->get_results()
  33. Custom form that store input in database
  34. Restoring WordPress posts from database only
  35. Issue with wp_insert_post and post_content field error Could not update post in the database
  36. wp_posts – guid update
  37. Performance Gains of Relational DB Setup
  38. store simple data in get_option()
  39. What are conventions about the schema of the $table_prefix
  40. Migrating non-WordPress CMS to WordPress, lots of data to move — possible solutions?
  41. BuddyPress: What’s the use of wp_bp_xprofile_data table and how does it get updated? [closed]
  42. storing database in version control
  43. Is deleting orphaned wp_options entries safe?
  44. How to build a movie database with wordpress?
  45. Sub-domain or 2nd, temporary different domain?
  46. Where is custom template file chosen for a post stored in the DB?
  47. How do i get user data from a custom table in the wordpress database by user ID?
  48. Converting WordPress into Android or iPhone app
  49. Safe way to find last inserted id in a table?
  50. Delete duplicate rows from wordpress database where a column is duplicate in phpmyadmin
  51. WooCommerce sku location in DB
  52. How to insert data into MySQL database from the form created in WordPress site
  53. WordPress DATABASE Update Manually?
  54. Multiple postmeta with same name for one post in wp_postmeta table
  55. Can I have multiple database users within WordPress?
  56. Modify Database in Multi-Site wp_usermeta table
  57. Structure of postmeta meta_value for woocommerce product download
  58. $wpdb doesn’t like to store arrays
  59. Connect to a remote database for wordpress in my own hosting server
  60. How to replicate a user plugin made table value, to this user’s custom meta table value?
  61. WordPress ‘repairing database’ in a constant error loop?
  62. What Is the Proper Way to Merge Usermeta Table to a an existing WP Database?
  63. Importing CSV into database table not working?
  64. Check if an option exists and get its value in one hit
  65. $wpdb error (Call to a member function insert() on a non-object)
  66. Problems with moving my WordPress site to another domain/server
  67. Is it important to have integers inserted using %d rather than %s?
  68. Export a custom Mysql database product catalog to WordPress
  69. Share users across multiple sites on same database, but with different domains
  70. Global__r connection timed out
  71. Connect to database in the header of my WordPress website
  72. WordPress url transformation script
  73. Moving WordPress site to new domain – database import [duplicate]
  74. Location of WP default mySQL tables creation file?
  75. Disable Database Update Required ? break my website
  76. Select From wpdb – Author/User Directory page
  77. Just created a WordPress Table can’t get $wpdb get row to work – need help
  78. $wpdb->insert not inserting all rows
  79. Best Practice? – Saving multiple Values as Serialized Data / Saving each Value per Row / Dedicated Table
  80. How to re-connect WP files in lampp/htdocs to new SQL database to recover site under development
  81. How can I find user role in Mysql?
  82. How would I see which wordpress posts have a revision history without opening each one?
  83. Creating a custom form with ability to query and submit to SQL
  84. Troubles when I want to connect to another DB
  85. Intermittent Yet Problematic Error – “Error Establishing A Database Connection”
  86. error establishing a database connection 3
  87. How to edit posts/pages without making the change live?
  88. Correct and secure way to access a custom SQL database in a custom PHP template file
  89. Does WordPress Support Using Named Pipes on the Windows Operating System?
  90. Missing latest posts and options after DB migration via phpMyAdmin
  91. Custom metabox does not store data
  92. wordpress database error
  93. How do i get value from wp_postmeta?
  94. Local host to server import problem
  95. featured image not showing up with mysql_connect
  96. Getting deleted users in database
  97. Options of accessing wordpress data from mobile app
  98. Getting data from a table using a query
  99. WP Multisite Users Not Linking
  100. Query a meta key using an array of values where the database value is a string