Allow spiders to crawl my site (selectable option in wp)

To allow crawling of your WP site you need to go to “admin panel >> Settings >> Reading” right before the “Save Changes” button is a checkbox with the label Search Engine Visibility make sure this is unchecked.

Related Posts:

  1. Are transients garbage collected?
  2. Are all options loaded to memory on each request?
  3. How does object caching work?
  4. How to pass arguments from add_settings_field() to the callback function?
  5. How to use checkbox and radio button in options page?
  6. how to update serialized options programatically?
  7. How to pass variable to add_settings_section() callback?
  8. Performance with autoload and the options table
  9. What’s the difference between Options & Settings?
  10. Using widget options ‘outside’ the widget
  11. How to load WordPress on non WP page?
  12. Options for CDN with WordPress Including Supporting Plugins?
  13. Option to set static front page disappeared from admin reading settings
  14. How to set up default values for a plugin?
  15. Difference between Option_Group and Option_Name in Register_Settings
  16. Add on the fly tabs to plugin options
  17. Why does WordPress use serialize rather than json_encode for the options table? [duplicate]
  18. Plugin options will not save in database
  19. No option to allow search engines to index my site in WP 4.3
  20. How to update an ‘array’ option using wp-cli [duplicate]
  21. Plugin options autoloading
  22. How to Create a Custom WordPress Install Package?
  23. Settings API – creating reusable form elements?
  24. Settings API – changing add_settings_field() output?
  25. Confirmation before deleting plugin options via uninstall.php
  26. Efficient way of saving plugin options
  27. Set WordPress settings programmatically
  28. Fallback when Transient API fails
  29. Submenu pages delete settings from options array when saved
  30. get_option() from another wordpress site
  31. How can I get all user options?
  32. register_setting() vs add_option()
  33. Settings API – save an array of options as one setting (array_push?)
  34. Where to hook register_settings for Settings API when also want to update options outside of Settings API?
  35. Add_settings_field() parameterizing callback?
  36. How much string content can I store in an option?
  37. Set a Default Value for an Option?
  38. Setting ‘autoload’ to ‘no’ with Settings API
  39. Why isn’t get_option array contents displaying?
  40. How to Save Different Settings Options Using Settings API and/or the Theme Optimizer
  41. Define WordPress image size in img tag
  42. Serialized settings in rest api
  43. Save Theme Options (options.php) From The Frontend
  44. Editor role not saving settings page for custom post type
  45. get_option() is not working even db contains the corresponding option_name and option_value
  46. Can’t output do_settings_sections . Can’t understand why
  47. checkbox with get_option not working
  48. Settings API – how to update multiple options manually?
  49. Single callback with multiple setting fields
  50. Proper use of option_page_capability_{$page_name}
  51. Settings API – how to update options manually?
  52. How to change the file upload directory on version 3.5?
  53. Which WordPress option stores the current active theme?
  54. update_option method with support of utf8
  55. Any way to partition wp_options?
  56. How do I add a value to a wp_options option that is an array?
  57. how can I detect that option value has changed?
  58. Can I use a space in an option name/key?
  59. How to save WordPress Options as an array?
  60. update_option not working in stand-alone PHP script
  61. How to verify this checkbox is checked?
  62. How to display some settings for super admin user only using Settings API
  63. Best practice differences in DB options and wp-config between live, staging and local WordPress environments?
  64. Logout redirects to a broken page(home URL is omitted)
  65. What to use , set_transient, set_option or file system? [closed]
  66. Is there a limit to the number of options you can store in one settings field of wp_options?
  67. wp_user_roles and Advanced Manipulation
  68. Settings API get_option best practices
  69. Custom theme options Radio inputs not saving
  70. Deploy pre-configured database
  71. Character Encoding for wp_options
  72. Access general settings trough wordpress files
  73. get_option & update_option for multiple input fields with same name
  74. Settings API: Change position of custom setting field
  75. Tab from Settings API resetting all options with INSERT INTO [closed]
  76. Clone plugins (and settings) to new installation?
  77. Getting settings saved two times in settings page with tab
  78. Can’t save options
  79. display all posts in wordpress admin crashing after 999 screen option
  80. How to cache posts based on $_GET? Option name is too long? Options / transients
  81. Putting my site live
  82. Where is the submitted $_POST array stored after an option page submission?
  83. update a value in wp_options [closed]
  84. get_option array value defaults and best practices
  85. Insufficient permissions to save options
  86. Can we allow users to choose front page from theme options?
  87. How to display usermeta on front end of site
  88. Add an option to a Child theme of Twenty Eleven
  89. save_post_{CPT} not updating the ‘sticky_posts’ option
  90. The Settings API – What is the purpose of default value in register_setting?
  91. settings_fields doesn’t appear to be running
  92. WordPress options page not saving
  93. How to store a value on WP_option table
  94. Changing the language in Site Language does nothing
  95. Settings API – Separating PHP and HTML
  96. Two settings_fields in one form
  97. Custom blog settings
  98. Run function on settings save
  99. Implementing action correctly
  100. Is there a capability for managing plugin options?