Scrape data from a website and post it on the blog

While importing from machine-readable formats, such as RSS is quite straightforward and usually has plenty of tools around… it is very different story with arbitrary HTML.

If you are not up to code this from scratch, then closest semi-automated tool I know is Dapper – it can process HTML pages and according to rules that you setup in visual interface convert it to other formats, including XML and RSS. On other hand I am not sure it will be able to handle your requirement of page discovery.

Related Posts:

  1. Java Package Does Not Exist Error
  2. Python circular importing?
  3. Where does the Media Library live in the database?
  4. Failed to import Media
  5. What is the required format for importing posts into WordPress?
  6. What exactly does the import tool do?
  7. WordPress Theme Options Import/Export
  8. One Click demo content installation feature in WordPress theme options panel
  9. Why do I lose all the slashes, i.e., ” \ “, in my blogs when I import XML files by the WordPress Importer plug-in?
  10. Import and replace existing page/post content
  11. Disabling HTML Filtering When Importing Into WordPress Multisite
  12. How to re-Import the WordPress XML file after editing?
  13. Migrating WP site to another URL
  14. Why shouldn’t @import be used to import a parent theme into a child theme?
  15. How to migrate a WordPress installation from one site to another, including all images?
  16. How to completely export and import WordPress?
  17. WXR import problem — not including categories
  18. Moving a blog from Tumblr to WordPress
  19. Download/View Schema (or DTD) for XML Import
  20. Using the Importer on an IIS Server
  21. GUID not updated on import
  22. Convert WordPress.com embed links to normal embeds
  23. Importing large data from blogger
  24. Faking the “onSave” event
  25. Better way to remove HTML syntax from all content
  26. Is there a way to import Blogger into bbPress?
  27. What can I expect when moving from a hosted (WordPress.com) blog to one hosted by Page.ly
  28. WXR slicing script
  29. can’t import xml file
  30. Importing XML to WordPress, permalink problem
  31. Error: Failed to import tag/post
  32. Update Attached Image Size after Import
  33. Exporting and Importing WordPress Media Libraries and Galleries
  34. WordPress does not import all pages and post
  35. Programmatically save one/any post
  36. How to access my wordpress via IP in shared hosting
  37. Feed format for woocommerce [closed]
  38. Is there a way to import a folder of HTML files into the blog?
  39. Using WordPress Importer, how to import media only?
  40. What is basic structure of xml for importing a page in wordpress?
  41. How to import content from WordPress.com to a self hosted WordPress installation?
  42. keep two blogs under the same domain
  43. Shows 1400 post published but don’t see them
  44. how to import a custom website into WordPress
  45. Moving WordPress site to an existing WordPress site
  46. WXR xml files are being imported as a TXT files and showing up under ‘Media’
  47. Import HTML/JS post to WordPress?
  48. Is it possible to import several xml from different sites to another?
  49. After imorting posts from another blog double line breaks have been replaced with single line breaks
  50. Import post from XML files into custom post type programatically [closed]
  51. Exporting featured image
  52. How to add biography of user while importing?
  53. How to import XML to WordPress as post and custom fields?
  54. product export and import using xml
  55. How to export a WordPress blog with no export function?
  56. Importing a database from a custom built CMS to WordPress
  57. Importing posts via MySql (a csv file) need to be automatically published
  58. Is there a way to show different source feeds on individual pages?
  59. Export WordPress from one domain to another domain
  60. Exporting by table
  61. automated import from blogger
  62. Error in importing wordpress xml [closed]
  63. How to import media from folder as opposed from old site?
  64. CSV Import Tables
  65. How to correctly move jquery script to external file
  66. WordPress Import (CLI) returns Error Establishing a database connection
  67. WordPress xml import too slow
  68. Import WordPress content to my website
  69. Existing posts hidden after WP import
  70. Request failed due to an error: (http_request_fail
  71. Error importing website: “There has been a critical error on your website.”
  72. After importing items are not displaying
  73. How to import posts correctly?
  74. import svg-files from wxr – (upload works, import not)
  75. WordPress All-Import to ATUM Stock Management
  76. How can I import a BlogML file into my WordPress site?
  77. How to import several big Import XMLs?
  78. How to make bulk changes to wordpress posts
  79. Pull specific data from CSV
  80. Merge two wordpress sites
  81. Import demo data into wordpress template
  82. When migrating all backslashes were stripped and special signs are converted in html entities
  83. How to do one-off import or data migration?
  84. Import xml feed
  85. WordPress import error
  86. Importing many times to succeed
  87. Max execution time error with stream_body() in wp-includes/class-http.php
  88. Importing demo content from plugin
  89. How to import data from Mingle Forum plugin to bbPress?
  90. Export plugin omits many images
  91. Create CSV for import from File directories?
  92. Export and import all Plugin options
  93. Import data from file larger than 15 MB
  94. How to import individual blog posts into WordPress?
  95. Failed Media Import (importing from LIVE to local)
  96. Astra Site is not importing
  97. WXR? Export from Drupal 7 – import into WordPress
  98. WP-all-import problems with large input file [closed]
  99. How to create import option for xml
  100. How to add featured thumbnail into import XML using URL image?