Bulk insert posts is really slow and skips entries

A queue may be your solution.

The individual items that should be imported can be put into a queue (e.g. in a database table) which can then be worked on 1 by 1 during the WP Cron process.

See how other plug-ins handle job queues

Hope that helps.

Related Posts:

  1. wp_insert_post bulk import 500 server error
  2. update_post_meta, xml parser
  3. keep wp_insert_post from adding duplicates
  4. XML FOLDER – wp_insert_post – how to assign XML variables to post
  5. Faster way to wp_insert_post & add_post_meta in bulk
  6. wordpress sanitize array?
  7. Is there a downside of using wp_defer_term_counting?
  8. wp_insert_post extremely slow on big table, direct query very fast
  9. wp_insert_post add meta_input
  10. tax_input not working wp_insert_post
  11. wp set object terms vs wp set post terms
  12. See error message from wp_insert_post function?
  13. Adding post thumbnail in programatically inserted post
  14. can’t edit post_modified in wp_insert_post (bug?)
  15. wp_insert_post incorrectly escapes HTML comments when they include tags
  16. What is considered the post’s creation date for wp_insert_post?
  17. Insert new term during new post creation
  18. wp_insert_post creates multiple pages
  19. wp_insert_post() getting slower the more posts
  20. How to allow data:image attribute in src tag during post insert?
  21. tax_input argument for wp_insert_post()
  22. What server settings are required to import WordPress XML file
  23. How can I stop wp_update_post messing up HTML example code?
  24. XMLRPC Avoid duplicate content
  25. How to insert custom function into wp_insert_post
  26. wp_insert_post does not write my post_name
  27. Is there a way to fire other functions from wp_insert_post
  28. Programmatically add terms to custom post types
  29. Organizing uploaded media with wp_insert_post() and wp_handle_upload according to time parameter
  30. wp_insert_post not returning post ID? [closed]
  31. wp_insert_post to schedule a post – but nothing happens?
  32. post_date_gmt and post_date [duplicate]
  33. wp_insert_post() Callback?
  34. Get data from wp_editor()
  35. How do I Import an RSS feed as WordPress posts without duplicates?
  36. wp_insert post doesn’t work
  37. Replace string with post_name on sidebar
  38. Create Posts using Import>RSS/WXR/XML and pass values to Custom Fields
  39. Visual Editor – Colorize Shortcodes
  40. Efficient way to save a lot of meta data
  41. wp_insert_post insert a post but return 0
  42. How to update post parent?
  43. wp_insert_post returns int(0)
  44. Contact Form 7 to featured image
  45. Conditionally set post_content in wp_insert_post
  46. How to use wp_insert_post to update meta box?
  47. wp_insert_post -> post_content not showing
  48. after wp_insert_post need to get the post id
  49. Is wp_insert_post exactly the same as publishing a post through the core UI?
  50. Could not get post ID from wp_insert_post()
  51. Creating New Page with WP_INSERT_POST Issue
  52. wp_insert_post is not creating revision in database
  53. wp_insert_post issue
  54. Inserting post, thumnail and custom fields with wp_insert_post
  55. add_menu_page Callback Function: Skip page content?
  56. WPML – Set language of inserted post
  57. using wp_insert_post inside of custom meta box
  58. wp_insert_post or wp_set_post_terms do not save taxonomy, but wp_set_post_terms does
  59. Making sure wp term relationships records are unique
  60. wp_insert_post if page doesn’t exist under current page
  61. Check if post is added manually or through wp_insert_post()
  62. When User Meta amended update Title and Slug of Post programatically
  63. Add file while inserting post
  64. Combining wp_insert_post() and update_post_meta()
  65. Programmatically create a post once a day
  66. wp_insert_post custom type and custom taxonomies
  67. Where to call wp_insert_user() and wp_insert_post() from?
  68. wp_insert_post at same time as saving post results in 502 Bad Gateway
  69. Add action to create new post after wp_insert_post fires? Think it’s creating an infitnite loop
  70. wp_insert_post alternatives for faster process
  71. WP-CLI –meta-input error: Warning: Invalid argument supplied for foreach()
  72. tax_input in wp_insert_post partly not working
  73. Issue with wp_insert_post() when post_content contains links?
  74. $user_id = wp_insert_user( $userdata ) Not working no errors
  75. $wpdb->insert() does not insert fields
  76. Insert multiple posts as parent of the first
  77. oEmbded with wp_insert_post() [embedly]
  78. wp_insert_post Only creates draft
  79. Save the Post ID from wp_insert_post($post); into a text file?
  80. wp_insert_post removes information when updating
  81. Problem with wp_insert_post
  82. Bug in wp_insert_post script and form, probably something simple I am not seeing
  83. Setting Post Date Returning “Notice: A non well formed numeric value encountered”
  84. Custom terms inserting as single string with commas, not separated
  85. wp_insert_post creating duplicate post with Safari
  86. Inserting post_id into guid before wp_insert_post
  87. “transition_post_status” action creating two post with wp_insert_post
  88. wp_insert_post fails at return statement (nothing is returned to the caller, the error displayed is: The Link You Followed Has Expired)
  89. wp_insert_post always returns 0 on one site, extensive testing done, can’t get to the bottom
  90. wp_insert_post order problem
  91. wp_insert_post limit 25
  92. wp_insert_post() crashing website
  93. wp_insert_post from XML feed only inserting first post
  94. Cannot insert HTML content even removing kses filters
  95. Import Instagram post as WordPress post
  96. get_page_by_title() not working as expected
  97. How to import several big Import XMLs?
  98. Insert Multiple Posts from JSON Results
  99. How can I automatically add a post with Latin characters?
  100. 500 error after wp_insert_post