If you have an actual robots.txt file in the root of your site then WP/plugins will be unable to override it. Its related functionality works with “virtual” file, when actual file doesn’t exist.
Otherwise it might be plugin conflict, try one related plugin at a time.
Related Posts:
- How to stop google from indexing spammed internal search results?
- Canonicalization issue regarding academic URL vs. blog URL
- Worried I have a funky .htaccess for WP site in light of strange search engine behavior
- Unexpanded shortcodes in search engine results
- Why does Google Image Search still display my images?
- What’s the most efficient solution when augmenting google custom search results with taxonomies?
- How to give a website (WordPress) a custom title and description in Google search
- how to secure wordpress website from google dorking
- Self-Hosted Blog on Google Search
- wp_redirect and search engine bots
- How do I use Google Custom Search to find and show words based on input characters on the same page in WordPress?
- website not indexed
- What is ' and why does Google search replace it with apostrophe?
- How to find Google’s IP address?
- Make Google index the entire post if it is separated into several pages
- What is a good robots.txt?
- Robots.txt not updating
- NoFollow Entire Website
- Stuck on my server root folder, robots.txt file not deleting
- Correct way to hide pseudo pages from being shown?
- Hiding Custom Post Type from Google?
- Create unique robots.txt for every site on multisite-installation
- Generating robots.txt dynamically
- Unwanted “crawl delay: 10” line added to my robots.txt
- Why does Google Webmaster Tools say my whole site is blocked by robots.txt when I have no robots.txt?
- Preventing Search Engines Indexing Pages 2, 3 and More?
- Add robots.txt to root
- Google saying is blocked by robots.txt without robots.txt on my website
- Hide pages from google and visitors
- How to publish page that can’t be detected by search engines?
- How to stop WordPress showing a virtual Robots.txt?
- Display title for search engine visitors
- Duplicate Australian E-Commerce site
- “No sitemap linked in your robots.txt file”
- Searching in shortcode contents
- Strange Search Queries in Apache Status
- How to redirect a Custom Google Search to a wordpress page/template?
- Best way to Integrate Google Search?
- Google Search Console: Index Coverage Error for /wp-includes/ php files
- Disallow author with robots.txt
- WordPress Schema.org Markup. What value does it add?
- SEO images in Nextgen Galleries
- Set noindex page-comment from Pages 2, 3 and More?
- How to password protect media library files (PDF)?
- How do I host WordPress on a hidden domain through a reverse proxy?
- robots.txt Not Updating
- Where is the “Privacy” menu for the “WP Robots Txt” plugin?
- How to solve Robots.txt problem with WordPress fresh install?
- How to make wordpress URLS google friendly for ajax driven sites?
- Questions about Robots.txt
- AMP Sitemap Error in Google Search Console
- How to Change The Title in WordPress For SEO
- install robots.txt to wordpress website admin
- Virtual robots.txt missing
- Robots.txt with WordPress and Joomla in same server
- Home page shows recent post, serps rank post within homepage
- What makes WP so SEO friendly?
- Why does do_robots() Allow: /wp-admin/admin-ajax.php by default?
- Redirecting to new URL structure and 301
- I have two problems ( SEO )
- How to prevent Google from indexing the /wp-content/ directory?
- WordPress 404 errors for old plugin files via Google Bot
- Homepage meta title and description not showing in search engines?
- Search Engine Visibility checkbox after indexed
- how to show Author information in search results
- Is this robots.txt making Google not to show some of my content?
- Can you please verify my robots.txt for wordpress
- XML Sitemap Generator can’t notify google and bing
- Add Google custom search to wordpress.com [closed]
- WPML and Yoast SEO setup on a wordpress site is not working properly
- How to stop showing my under development site on Google Search [closed]
- Where to put robot.txt and sitemap.xml for wordpress installed in its own directory
- How to remove WordPress Virtual Robots.txt that keeps overriding my root robots.txt? [closed]
- Change meta data of pdf file
- Why last blog post excerpt is shown instead of meta description? [closed]
- Old robots.txt file not changing, can’t update to the current robots.txt
- Sitelinks Search box schema confusion
- Disallow: /wp-* in robots.txt?
- Google isn’t able to search my website
- What is the meaning of User-agent and Disallow in robots.txt file in wordpress
- Googlebot adding /feed at the end of my URLs
- Connecting Google Site Search with WordPress Taxonomies/Categories/Tags
- When clicking on submit from my searchform it takes me to home.php
- How can I remove image taxonomy pages from my theme and from Google?
- auto generated robots.txt problem
- Setting up robots.txt with Yoast’s Seo plugin
- How to dissallow all wordpress posts in robots.txt?
- Hide plugins and theme from public
- Use a filter for wp_robots to block CPT/feed/
- WordPress site using Yoast SEO being blocked from indexing by robots.txt
- How to stop the custom post type URL from the google search?
- Can I replace the search bar with Programmable Search by Google?
- Google indexing duplicate page content with Page #### in post title and /page-2 in permalink instead of the ones I set
- Should I set a page as “No-index” if I include it’s content within the front-Page.php via this method?
- Bing/msn bots is heavily requesting random of my website
- SEO Site Title appearing in google search despite not being added
- How to noindex, follow a specific category wordpress?
- Robots.txt file not updating
- How to block access to Crawlers to any Image on a Private page
- Why are some user agents still getting a meta robots tag with noindex from my site?