Best way to store 1 billion+ posts?

I don’t know about how long it will take to create that many tables, especially if you do it in one go, but you can use $wpdb to handle the creation. There’s an article on the Codex regarding creating custom tables, https://codex.wordpress.org/Creating_Tables_with_Plugins

And it crossed my mind that perhaps using some external tool to handle the database querying could potentially make the queries run faster. Elasticsearch (I’m not an affiliate), in tandem with ElasticPress, is the only one I’ve heard of, but I’m sure there’s plenty of similar tools. Maybe that could be worth checking out?

Related Posts:

  1. WordPress database scalability from the code perspective
  2. Performance tips for a large user base [closed]
  3. WP_Options ID high
  4. WordPress for a very large website
  5. WordPress database becoming huge. How to analyze and optimize it? fear of running out of memory
  6. Improve or optimize a very slow query
  7. WooCommerce with thousands of products – site is very slow – optimize db queries? [closed]
  8. Efficiency on displaying random authors based on large database
  9. How to solve slow WordPress site caused by attachment_metadata
  10. Relationship between performance and database size
  11. Database slowdown after update to 3.4.1
  12. wp_redirection_404 table has grown to 7GB
  13. Which is more efficient? Using usermeta, or creating a new MySQL table?
  14. One post carries 30 postmeta values, is this too much?
  15. Multiple wp_options tables to share content across installs
  16. Improve performance by removing unnecessary database queries
  17. fastest replacement DB
  18. How to prevent/delay MySQL connections when an object cache is used?
  19. Does auto_load to ‘no’ in wp_options improve performance
  20. How to combine multiple wp_insert_post into one in order to gain better performance
  21. Optimizing function that automatically creates internal links based on post title string
  22. Is there anyway to split posts to different databases?
  23. Job and Employee Performance Tracking with Product Safety
  24. What structure and database storage method should I use for temporary storage that may be written concurrently?
  25. Get all top categories, then only 3 posts for each
  26. Optimize WP site for millions of posts
  27. Counting user’s comments – efficient way?
  28. Performance bug – slow DB query
  29. Mysql Queries per Visit – Crazy High
  30. What is an ORM, how does it work, and how should I use one? [closed]
  31. What is the difference between an ORM and an ODM?
  32. What is this JavaScript “require”?
  33. Rename a table in MySQL
  34. How should I tackle –secure-file-priv in MySQL?
  35. What is this JavaScript “require”?
  36. What is “Advanced” SQL?
  37. What’s the difference between identifying and non-identifying relationships?
  38. Can’t connect to MySQL server on ‘127.0.0.1’ (10061) (2003)
  39. Can’t connect to MySQL server on ‘127.0.0.1’ (10061) (2003)
  40. Can’t connect to MySQL server on ‘127.0.0.1’ (10061) (2003)
  41. What are the differences between B trees and B+ trees?
  42. MySQL SELECT increment counter
  43. How to resolve ORA-011033: ORACLE initialization or shutdown in progress
  44. Example of a strong and weak entity types
  45. Oracle SQL query for Date format
  46. phpMyAdmin – Error > Incorrect format parameter?
  47. Strange Characters in database text: Ã, Ã, ¢, â‚ €,
  48. Difference between partition key, composite key and clustering key in Cassandra?
  49. How SID is different from Service name in Oracle tnsnames.ora
  50. What is a relation in database terminology?
  51. Failed to connect to mysql at 127.0.0.1:3306 with user root access denied for user ‘root’@’localhost'(using password:YES)
  52. Database vs File system storage
  53. Can I have multiple primary keys in a single table?
  54. Exclude Statement in SQL
  55. How do you query for “is not null” in Mongo?
  56. What is a file based database?
  57. Is it fine to have foreign key as primary key?
  58. Storing Images in DB – Yea or Nay?
  59. Using wpdb to connect to a separate database
  60. how to Optimize WordPress database for 10 million post? [duplicate]
  61. MySQL Database User: Which Privileges are needed?
  62. Why is my database import losing text widget data?
  63. Database synchronization between dev/staging and production
  64. Keeping WP database synced across multiple developers using git
  65. WPDB Insert or if exists Update
  66. Multiple developers / editors working on a site in progress
  67. How can I make updates to a site, on a development copy, but then move updates back without overriding live site’s evolving database?
  68. get_results using wpdb
  69. Will it break my site if I delete all transient records in wp_options table?
  70. Checking if Database Table exists
  71. Why WordPress choose data serialization over json_encode?
  72. Delete all posts of a custom post type—efficiently
  73. What’s the simplest way to backup my WordPress database?
  74. WordPress (MyISAM) database is slow, should I switch to InnoDB?
  75. $wpdb won’t insert NULL into table column
  76. Performance of my permalink structure?
  77. Relaunch 4.2 utf8mb4 database upgrade
  78. Fastest way (least amount of steps) to locally import a remote database using WP-CLI
  79. Safest way to bulk delete post revisions
  80. Please explain how WordPress works with MySQL character set and collation at a low level
  81. Solution for database version control and deployment?
  82. The MySQL alternatives: Do Percona Server and MariaDB work well with WordPress, and do they make WordPress go better?
  83. How many users can WordPress handle?
  84. Get error messages when $wpdb->insert() returns false?
  85. Detecting errors generated by $wpdb->get_results()
  86. Staging sites, how do you manage synchronising updates in the DB?
  87. Does dbDelta delete columns as well?
  88. How to get the post publish date outside the loop?
  89. MariaDB as a backend database
  90. wpdb update add current timestamp not working
  91. Site stuck in “Database Update Required” loop
  92. How to fetch Data in WordPress using MySQLi or $wpdb
  93. WordPress Database lost auto increment
  94. Count & Display Database Queries
  95. Connect to database using wordpress wp-config file
  96. How can I make a WordPress database portable and url independent?
  97. Are There Any Plans for WordPress to Support Databases Other Than MySQL?
  98. wpdb->insert multiple record at once
  99. How to migrate a HTTPS WordPress installation to localhost?
  100. Two WordPress sites sharing the same content
Hata!: SQLSTATE[HY000] [1045] Access denied for user 'divattrend_liink'@'localhost' (using password: YES)