It’s dynamically generated by the function do_robots()
, which has both an action (do_robotstxt
) and a filter (robots_txt
). If you create a robots.txt
file in your WordPress root, it will (probably) be served up when /robots.txt
is requested, otherwise processing will fall back on WordPress.
Your current file looks like this:
User-agent: *
Disallow:
Sitemap: http://mikewills.me/sitemaps/mikewills-me.xml.gz
The first two settings are appropriate for an indexable blog. So, you may just be waiting for Google at this point. Maybe you need to request reconsideration of your site.
Related Posts:
- How to migrate subsite from dev multisite to production multisite
- How to share WordPress core library
- Programmatically create blogs with dummy content on a WPMU site
- How to individually set WP_DEBUG on a sub-directory multisite?
- Create multiple subdomains for multi-site from a database
- How can I have network sites not use year/month folders by default?
- 4 single sites VS multisite wordpress
- multisite htaccess 301 redirects
- Two-level multisites in WordPress
- using 1 form shortcode (si or cf7) for all multisite sites [closed]
- How to manage multiple domain with different languages on each domain with single wordpress installation?
- Display custom homepage text based on domain
- Add new domain to ‘My Sites’ using network admin
- Is there an advantage of using multisite if I have multiple WordPress websites for myself?
- Redirect loop (only for multisite network admin)
- Jetpack Blog Subscriptions on Multisite [closed]
- current_user_can(‘Administrator’) does not return true in multisite if user is Administrator but NOT Super Admin
- cant enable theme in multisite
- Deleting a user in multisite
- Recover from failed multisite conversion
- Proper Network Activation problem has been fixed in wp 3.3.1 or not?
- On WordPress Network(multisite), Sub Blogs in Subdirectories or Subdomains? What’s better?
- Is there a way to separate a site inside a network (multisite) into its own wp site?
- How to know if a site is using Multisite?
- Cookie nonce is invalid – Multisite
- Multisite setup on VVV with bedrock
- How can I delete a user from entire multisite nework
- Using A Shared/Common Theme Across Multiple Sites
- Multisite Network menu links not updating
- Activate Child Theme with Codex
- Multisite Network Localisation
- Can set_transient() be used in multi-site?
- WPML tables not deleted when removing multisite subsite, need help clearing up my sql-file! [closed]
- Why does my multisite blog doesn’t show users?
- What would you recommend for hosting 10+ individual wordpress websites?
- What sites are you registered to when joining a multisite?
- ERR_TOO_MANY_REDIRECTS IN MULTISITE NETWORK DASHBOARD
- Redirect only posts to New Domain
- Image problem – Multisite image upload broken
- WordPress Multisite new sites in directory
- add_rewrite_rule on multisite doesn’t work
- web.config breaks the themes for sub-directory multisite
- How to configure Multisite Network with randomized hostnames?
- Different use for WordPress Multisite
- wp_insert_site() is triggering database error in a unit test
- Multisite: How to get a list of installed languages
- “You must be logged in to comment” but I am already logged in
- Multisite User Sync Question about blog authorship
- Is the Multi site functionality a viable option for Country and Language targeting?
- WordPress multisite .htaccess causes 500 error on old *.php URLs
- WP-CLI cron on multisite using WP-Toolkit “succeded”, but callback not executed
- WordPress multisite suddenly malfunctioning
- Site redirecting to http://example.com/wp-signup.php?new=example.com
- Cannot use pre_set_site_transient_update_themes from within a theme in multisite
- Login problems on multisite installation with different domains
- Multisite, with virtual root
- Domain Mapping for WordPress MU and https redirection – How to?
- Move wp-content htacess
- FeedWordPress duplicated posts problem
- WordPress MU subdomain vhost
- Domain mapping with Multisite links are wrong
- Install multisite wordpress on a subdomain and map to top level domains
- Get latest blog post from another multisite blog
- How do I stop exactly one blog from network ever setting cookies?
- How to use different domains subdomains in WP multisite? [duplicate]
- Combining user database tables while keeping all other data in seperate for multiple sites?
- How to make multi site with single Database?
- Two Websites with the same administration Panel In WordPress
- Creating a multilingual multisite
- Automatically Insert Into Post when uploading Media
- Hiding media uploaded by other users in wordpress multisite?
- Multitenant with a single site
- Multisite Create New Blog Plugin
- Configure WordPress Multisite Pages with Custom Permalinks
- WPMU function get_blog_details, last_updated/registered and formatting time and date string
- Multisite WordPress on a site that is more than 30 days old
- How to fix redirection of Post/Page of wordpress inside the wordpress?
- Multi Site Language switcher
- How to use the same “wp_posts” table for different subdirectories in the same DB?
- Multisite WordPress doesn’t work properly on virual hosts
- Displaying Multisite ID number
- Installing other applications alongside WordPress multisite subdomains
- Where does WordPress Mu DB store the link of network admin dashboard
- wordpress multisite – handle Database
- Importing Posts into New Website with Same User ID’s
- network admin pages not linked to correctly
- In Multisite: Site / Blog IDstill exists after deleting site
- Styles not being applied to multisite setup
- Setting up multisite with NginX
- Multiple domain with one database
- Right approach in doing this signup process
- Editing links to new Site url when user Creates a New Site
- Access from template info of another blog (in the same network)
- WordPress Multisite – is this possible?
- WordPress on Nginx – Missing admin/toolbar
- 4th Network Site Database Errors?
- WordPress MultiSite Link Cloaking/Redirect Solution?
- How to disable admin access on new site registration for user in Multisite?
- Maximum Execution Time Exceeded Error while creating New Site in Multisite, Increasing Time Not working
- Moved WP Multisite, cannot access sites