Where is the robots.txt stored for a WordPress Multisite install?

It’s dynamically generated by the function do_robots(), which has both an action (do_robotstxt) and a filter (robots_txt). If you create a robots.txt file in your WordPress root, it will (probably) be served up when /robots.txt is requested, otherwise processing will fall back on WordPress.

Your current file looks like this:

User-agent: *
Disallow:

Sitemap: http://mikewills.me/sitemaps/mikewills-me.xml.gz

The first two settings are appropriate for an indexable blog. So, you may just be waiting for Google at this point. Maybe you need to request reconsideration of your site.

Related Posts:

  1. How to migrate subsite from dev multisite to production multisite
  2. How to share WordPress core library
  3. Programmatically create blogs with dummy content on a WPMU site
  4. How to individually set WP_DEBUG on a sub-directory multisite?
  5. Create multiple subdomains for multi-site from a database
  6. How can I have network sites not use year/month folders by default?
  7. 4 single sites VS multisite wordpress
  8. multisite htaccess 301 redirects
  9. Two-level multisites in WordPress
  10. using 1 form shortcode (si or cf7) for all multisite sites [closed]
  11. How to manage multiple domain with different languages on each domain with single wordpress installation?
  12. Display custom homepage text based on domain
  13. Add new domain to ‘My Sites’ using network admin
  14. Is there an advantage of using multisite if I have multiple WordPress websites for myself?
  15. Redirect loop (only for multisite network admin)
  16. Jetpack Blog Subscriptions on Multisite [closed]
  17. current_user_can(‘Administrator’) does not return true in multisite if user is Administrator but NOT Super Admin
  18. cant enable theme in multisite
  19. Deleting a user in multisite
  20. Recover from failed multisite conversion
  21. Proper Network Activation problem has been fixed in wp 3.3.1 or not?
  22. On WordPress Network(multisite), Sub Blogs in Subdirectories or Subdomains? What’s better?
  23. Is there a way to separate a site inside a network (multisite) into its own wp site?
  24. How to know if a site is using Multisite?
  25. Cookie nonce is invalid – Multisite
  26. Multisite setup on VVV with bedrock
  27. How can I delete a user from entire multisite nework
  28. Using A Shared/Common Theme Across Multiple Sites
  29. Multisite Network menu links not updating
  30. Activate Child Theme with Codex
  31. Multisite Network Localisation
  32. Can set_transient() be used in multi-site?
  33. WPML tables not deleted when removing multisite subsite, need help clearing up my sql-file! [closed]
  34. Why does my multisite blog doesn’t show users?
  35. What would you recommend for hosting 10+ individual wordpress websites?
  36. What sites are you registered to when joining a multisite?
  37. ERR_TOO_MANY_REDIRECTS IN MULTISITE NETWORK DASHBOARD
  38. Redirect only posts to New Domain
  39. Image problem – Multisite image upload broken
  40. WordPress Multisite new sites in directory
  41. add_rewrite_rule on multisite doesn’t work
  42. web.config breaks the themes for sub-directory multisite
  43. How to configure Multisite Network with randomized hostnames?
  44. Different use for WordPress Multisite
  45. wp_insert_site() is triggering database error in a unit test
  46. Multisite: How to get a list of installed languages
  47. “You must be logged in to comment” but I am already logged in
  48. Multisite User Sync Question about blog authorship
  49. Is the Multi site functionality a viable option for Country and Language targeting?
  50. WordPress multisite .htaccess causes 500 error on old *.php URLs
  51. WP-CLI cron on multisite using WP-Toolkit “succeded”, but callback not executed
  52. WordPress multisite suddenly malfunctioning
  53. Site redirecting to http://example.com/wp-signup.php?new=example.com
  54. Cannot use pre_set_site_transient_update_themes from within a theme in multisite
  55. Login problems on multisite installation with different domains
  56. Multisite, with virtual root
  57. Domain Mapping for WordPress MU and https redirection – How to?
  58. Move wp-content htacess
  59. FeedWordPress duplicated posts problem
  60. WordPress MU subdomain vhost
  61. Domain mapping with Multisite links are wrong
  62. Install multisite wordpress on a subdomain and map to top level domains
  63. Get latest blog post from another multisite blog
  64. How do I stop exactly one blog from network ever setting cookies?
  65. How to use different domains subdomains in WP multisite? [duplicate]
  66. Combining user database tables while keeping all other data in seperate for multiple sites?
  67. How to make multi site with single Database?
  68. Two Websites with the same administration Panel In WordPress
  69. Creating a multilingual multisite
  70. Automatically Insert Into Post when uploading Media
  71. Hiding media uploaded by other users in wordpress multisite?
  72. Multitenant with a single site
  73. Multisite Create New Blog Plugin
  74. Configure WordPress Multisite Pages with Custom Permalinks
  75. WPMU function get_blog_details, last_updated/registered and formatting time and date string
  76. Multisite WordPress on a site that is more than 30 days old
  77. How to fix redirection of Post/Page of wordpress inside the wordpress?
  78. Multi Site Language switcher
  79. How to use the same “wp_posts” table for different subdirectories in the same DB?
  80. Multisite WordPress doesn’t work properly on virual hosts
  81. Displaying Multisite ID number
  82. Installing other applications alongside WordPress multisite subdomains
  83. Where does WordPress Mu DB store the link of network admin dashboard
  84. wordpress multisite – handle Database
  85. Importing Posts into New Website with Same User ID’s
  86. network admin pages not linked to correctly
  87. In Multisite: Site / Blog IDstill exists after deleting site
  88. Styles not being applied to multisite setup
  89. Setting up multisite with NginX
  90. Multiple domain with one database
  91. Right approach in doing this signup process
  92. Editing links to new Site url when user Creates a New Site
  93. Access from template info of another blog (in the same network)
  94. WordPress Multisite – is this possible?
  95. WordPress on Nginx – Missing admin/toolbar
  96. 4th Network Site Database Errors?
  97. WordPress MultiSite Link Cloaking/Redirect Solution?
  98. How to disable admin access on new site registration for user in Multisite?
  99. Maximum Execution Time Exceeded Error while creating New Site in Multisite, Increasing Time Not working
  100. Moved WP Multisite, cannot access sites

Leave a Comment