There are two places bots would look: your sitemap (if you submitted one to google), and your robots.txt. WordPress itself doesn’t put anything in robots.txt (unless you set your site to private, then it tells the bots not to index anything), nor does it create xml sitemaps that google would use.
There are a few plugins that will do this for you, though. I know Google XML Sitemaps is popular, and works for me. Yoast’s SEO plugin also creates sitemaps for you.
I think the easiest way to get Google to start indexing correctly is to create a sitemap with one of those two plugins and then submit it to google using google webmaster tools.
Related Posts:
- WordPress Permalinks not working in Apache2 Ubuntu 14.04
- Get current URL (permalink) without /page/{pagenum}/
- How to get pretty URLs with add_query_arg in permalinks
- How does wordpress keep track of post id when post id is not used in permalinks?
- Permalinks to Custom does not work (out of box)
- How to add query parameters to all internal links?
- How to make draft posts or posts in review accessible via full url / slug?
- nginx – permalinks with .php in url not working
- Social Media Links on homepage – within posts/post loop
- Custom rewrite rules for feeds of custom queries (query_var query strings in URL)?
- How to change the link structure of the homepage?
- Remove words from permalink when saving post automatically?
- WordPress | Convert #038; to &
- How to add category to the permalink and breadcrumb?
- Rewrite my default post URL
- Get permalink to page?
- Parent Category link to its sub categories on different page
- How can I link a file in admin with a button?
- Remove Dash/Hyphen From WordPress CustomPosttype Permalink
- Auto-create a pretty permalink for a bunch of posts
- Permalinks: Page Not Found
- wp_logout_url redirects to incorrect page because of pagination
- WordPress blog posts permalinks giving 404 on nginx
- how to add rewrite rule to wordpress default post type
- Only default permalink is working mod_rewrite enabled
- Is a permastruct possible on pages?
- Custom WordPress user permalink
- Custom Permalinks for Posts only
- How to add a variable as a tag base?
- WPML – how to get the permalinks to display also the default language
- Why does the ‘Month and Name’ Permalink Format not Work on my new WordPress Site (running on IIS7)?
- How do I add /blog/ as a prefix to permalink structure for posts, categories & tags?
- Custom permalink structure for posts in specific category
- force permalink slug for page vs post_type slug parent
- WordPress url ingore permalinks setting [closed]
- Integrating wordpress into existing site and setting up htaccess?
- Rewrite URLs for LeadPages due to subdirectory installation
- Add more structure tag to permalink?
- wp_publish_post to saved draft, permalinks broken
- display dynamic content based on url slug on custom page
- How to generate a list of all urls
- Let me choose permalinks
- All URLs are having ‘/blog/’ appended to them.
- Slugs Disappeared Leaving 404s – Quick way to repopulate?
- Path to Pages Resolves to Archive instead of Actual Content
- permalink %year% of pre-written posts to be published next year, in the mysterious future (*)
- Permalink slug no longer editable when using post_type_link filter
- Unique one time use URL
- Remove some rewrite rules in wordpress
- the_permalink on the homepage vs posts for sharing links
- Test site pages go to main site
- Inserting a string in the middle of page’s permalink?
- When I click on a single post my browser goes to about:blank#blocked and the page is white
- WordPress Permalinks problem
- Pagination using paginate_links
- How to get rid of an extra middle part my permalink
- Access or edit custom generated permalinks with WP_Rewrite
- Add custom query vars to pretty permalinks
- How Can I Use a Custom AccessFileName?
- xammp server permalink by postname not working
- Redirect after permalink changes
- replacing post ID by custom post name in url
- Change type of permalinks on TinyMCE link dialogue
- Problem with special character WordPress
- Permalinks and page store
- All in One Seo and Permalinks
- Change pemalink for one single post without redirect
- Add .html permalink to post if specific category
- Strip subcategory base from URL
- rewrite based slug standar post wp
- How to update wordpress permalink structure with author role?
- How to turn a custom query string into permalink?
- Change Project permalink to custom URL
- Edit Post Permalink option removed, looking for possible causes
- Site Tagline ended up in permalink
- Custom structure permalink preventing 404
- Got 404 error when changed siteurl via DB in WordPress
- Add slug to default post permalinks ONLY
- Permalinks don’t update nor link properly
- Getting 400 Bad request Error when trying to open posts after updating to wordpress 5.0
- Category Base permalinks
- Pretty Filter URL
- Add URL to selected post in meta box
- How to change dynamic link to relevant post
- Auto-generated pretty permalink not using title since 4.4 update
- Problems with permalinks after update wordpress 4.2
- Add Custom Pagination Permalink
- Prevent guessing slug
- Pretty permalinks to work for lighttpd webserver?
- Pages included in another page and duplicate content issues for SEO
- Customize category permalinks
- WordPress archive posts returns user to homepage
- broken permalinks in responsive layout
- URL to an image in a post is changing when permalink is set to custom. Can I avoid this?
- permalinks url with woocommerce
- How to get the perfect WordPress, WooCommerce, Custom Post Type pretty permalinks?
- Blog url disappears
- Not recognizing my custom templates in hierarchy
- Permalinks get lost periodically
- Stymied by 500.5 error for WordPress on IIS 8 / Windows Server 2012