Handling large N data in WordPress

  1. Custom table(s). WordPress posts are not structurally a fit for what you are doing. Trying to use them for this will result in a lot of unnecessary data processing and storage. But you need to think through your own database design and you need to be good with SQL or you will end up inefficient anyway.

  2. I am not convinced transients will help you here. It sounds like you are going to altering data a lot. That may negate the benefits.

  3. Serialize if you must store an array. JSON might be smaller but serialize has more data– a kind of simple checksum value for one. Size shouldn’t matter. The option_value column of wp_options is longtext. That is about 4GB. The limiting factor is going to be system memory, not the column.

  4. Client side processing (Javascript) is many, many times slower than server side (PHP) not to mention the data transfer time. If you have prepared data in a transient that might help, but as before it sounds like you are going to be altering data a lot.

  5. No idea what this means.

Related Posts:

  1. Rename a table in MySQL
  2. How should I tackle –secure-file-priv in MySQL?
  3. Can’t connect to MySQL server on ‘127.0.0.1’ (10061) (2003)
  4. phpMyAdmin – Error > Incorrect format parameter?
  5. Failed to connect to mysql at 127.0.0.1:3306 with user root access denied for user ‘root’@’localhost'(using password:YES)
  6. Using wpdb to connect to a separate database
  7. Why is my database import losing text widget data?
  8. Checking if Database Table exists
  9. The MySQL alternatives: Do Percona Server and MariaDB work well with WordPress, and do they make WordPress go better?
  10. How to fetch Data in WordPress using MySQLi or $wpdb
  11. Connect to database using wordpress wp-config file
  12. wpdb->insert multiple record at once
  13. How To Export/Import WordPress (MySQL) Database Properly Via Command-Line?
  14. How to define composite keys with dbDelta()
  15. Is it possible to define two databases for one installation?
  16. WordPress for a very large website
  17. WooCommerce with thousands of products – site is very slow – optimize db queries? [closed]
  18. How do I add indexes to WordPress Database?
  19. Huge wp_options table
  20. “MySQL server has gone away” since update to 3.8
  21. Error establishing a database connection – with Debug Data
  22. How to execute mulitple statement SQL queries using $wpdb->query?
  23. Can I transfer a mysql database to another site?
  24. Database with mixed collation (utf8mb4 & utf8_general_ci)
  25. MySQL Syntax Error upon restoring database from backup [closed]
  26. Help running a MySQL query to update all wp_#_options tables in a Multisite install
  27. Set Display Name to first and last name (phpmyadmin SQL Query)
  28. Size article thumbnails and retrieve them directly from database
  29. Is it safe to convert tables from MyISAM to InnoDB?
  30. Emojis getting converted to “?”
  31. Migrating database / content of non-CMS site to WordPress
  32. Does WordPress ever need multiple databases?
  33. Why are no posts showing despite my apparently correct DB restoration?
  34. Delete all post meta except featured image Using SQL
  35. How do I properly update the WordPress database password?
  36. wpdb_prepare with multiple or condition
  37. Adding new row to wp_post table
  38. WordPress Install and Database on separate hosting?
  39. SQL Error wp_commentmeta – incorrect table definition
  40. WordPress database error – Error in SQL syntax – I can’t identify any error?
  41. WordPress and MySQL: how to transfer Meta_key and Meta_Value from one post_id to another
  42. How do I get the posts within a certain year/date(with sql query)?
  43. Error establishing database connection – high traffic?
  44. Using GROUP CONCAT in my-sql query with wp_usermeta table
  45. Switching Databases in LocalHost
  46. Create table from array with prepare
  47. How to prevent/delay MySQL connections when an object cache is used?
  48. Migrating from PDO using SQLite to clean new install using MySQL
  49. Call to undefined function get_user_meta() – trying to access data in MySQL from custom fields
  50. Duplicated site isn’t recognized as a site
  51. Have working sql query… trying to adjust it to use $wpdb
  52. Error establishing a database connection,
  53. Changing root password in PHPMyAdmin for WordPress Database when going live
  54. How to properly check if a table exists in WordPress Database using Show Tables Query
  55. Can’t update WordFence Options, clear data manually
  56. Changing between Local Host DB to Production DB and in reverse
  57. creating new field on mysql
  58. How and where is wordpress adding mySQL content to database?
  59. SQL query to set posts in bulk based on the post content
  60. Query Column of Specific ID from Database Table
  61. How can I detect right db type?
  62. How to create more than one new wpdb object?
  63. Buddypress avatar image in database [closed]
  64. Files on Localhost, Database on Server
  65. Remote database -> massive response time increase?
  66. Second ezSQL initialization for MSSQL
  67. Fetch a single row from a custom table for to a given ID
  68. Database create or redirect
  69. Getting “Error Establishing a Database Connection” on localhost in new Mac OSX Lion environment
  70. Cloning blog to localhost via WAMP
  71. Only allow user to access a link once a year, based on their joining date
  72. How to escape percentage sign(%) in sql query with $wpdb->prepare?
  73. DB prefix not updating
  74. Recovery – Restore Database after moving folder location locally
  75. Replacing javascript link in WordPress database without getting mysql syntax errors
  76. How to edit custom table data in frontend
  77. local wordpress broke after changing URL
  78. “BS_” rows in postmeta table
  79. how to access 2nd Mysqli Database from different server for wordpress
  80. Error establishing a database connection – WordPress setup, everything else is working
  81. Exporting Post ID, Post Title, Primary Category and Primary Category ID
  82. How to map data on CSV to web pages?
  83. How to create index (sql) to a meta_key?
  84. Search and Replace in Windows XAMPP site
  85. WPCLI search and replace in a particlar site dir effect another site-dir
  86. How can i syn wordpress user table with a stand-alone php script?
  87. insert data from a form:: Warning Empty query mysqli::query()
  88. How can I get $wpdb to show MySQL warnings?
  89. mySQL database size large, but tables size less
  90. WordPress Database Posts Table query
  91. Hang Up Followed By Can’t select database
  92. How to extract some part of WordPress full source code
  93. Mysql Queries per Visit – Crazy High
  94. Why is converting my database to UTF-8 truncating entries?
  95. using same mysql user with many databases
  96. Why are my WordPress post queries so slow?
  97. Migrated to Namecheap, now Trouble with Database & wp-config [closed]
  98. export individual posts to text files or a single csv file
  99. Custom wordpress SQL statement for a website
  100. How to find fresh (last modified) and sql backup?