Where to put robot.txt and sitemap.xml for wordpress installed in its own directory

You can safely place your robot.txt file as well as the sitemap.xml file into your websites root directory and NOT the WordPress directory.

When a robot visits your site, the first place it checks is http://sitename.com/robots.txt, hence you want to keep these files at the root of your domain.

You can also disallow what the robot has access to 

    User-agent: *    # applies to all robots
    Disallow: /      # disallow indexing of all pages

    Disallow: wordpress/wp-admin/
    Disallow: wordpress/wp-includes/
    Disallow: wordpress/wp-content/plugins/

W3.org

Related Posts:

  1. PHP – Move a file into a different folder on the server
  2. get_template_directory() vs bloginfo( ‘template_directory’ ) vs TEMPLATEPATH
  3. Can I change get_template_directory_uri()?
  4. Custom Post Type Archive in Sub Folder
  5. How to point my domain to a WordPress install in a sub-directory?
  6. Can I put my WordPress theme files in another folder?
  7. Multiple domains for multiple single installs
  8. How to Create Hierarchical Directory for Nation Wide Mental Health Services
  9. How to create new folder in wp-content root same like upload folder?
  10. How do I set up single sign on for multiple WP installs across the same domain?
  11. Why doesn’t WP_PLUGIN_DIR definition use DIRECTORY_SEPARATOR?
  12. How to copy one folder to another folder recursively
  13. issues including a file from a plugin directory
  14. local folder permissions vs chown — security considerations
  15. Creating directory in uploads: mkdir vs wp_mkdir_p
  16. How would you detect if WordPress is installed in a subdirectory (not root)?
  17. Cant get wordpress to work on subdirectory
  18. Two identical wp-includes directories on server
  19. What is the recommend directory in which I can upload a new library?
  20. “No sitemap linked in your robots.txt file”
  21. Second wordpress installation on subdirectory
  22. Install theme on multiple domains
  23. How to create an Online Dictionary Using WordPress? [closed]
  24. Include file from higher level
  25. how to create a folder in wordpress
  26. wordpress blog in subdirectory or subdomain
  27. Accessing WordPress installation in its own directory at domain root
  28. Right permissions to WordPress directory
  29. Can I install a new WordPress site inside a sub-directory of an existing WordPress site?
  30. Template Hierarchy tag-{slug}.php directory
  31. more than one upload directory?
  32. Change directory of javascript files
  33. Theme in wp-content but my index.php search theme files in root
  34. get_query_var not working for subdirectory
  35. robots.txt Not Updating
  36. How can I have nginx serve WordPress at /blog?
  37. Subdomain redirects to subdirectory [closed]
  38. How to make use of WP templates within a nested site structure?
  39. Plugins will only be installed with 777 on folder. Solution?
  40. How to create directory using username within theme
  41. 2 WordPress sites in 2 sibling folders on one domain
  42. Main WP page and subfolder WP with the same name. How to prioritize for main Wp
  43. Auto-create a post with last 10 images in WordPress directory
  44. Session Expired when WordPress Address (URL) and Site Address (URL) are different
  45. After changing wp from subdirectory to root I can’t preview any changes to a page or post
  46. Moving from one test to multiple final environments
  47. WordPress in a sub directory but not images
  48. Hiding Directory Path
  49. Moving WP from /blog to root directory
  50. Should custom directories be created under the wp-content directory?
  51. Use of Folders within WordPress
  52. Folder keeps popping up in my public_html directory and overriding WordPress page structure
  53. Hosting my WordPress site out of a subdirectory
  54. Theme file structure best practice
  55. Clean installation missing its /wp-content folder
  56. Path in dev server works; same path in prod server is broken
  57. What is wp-admin/meta for?
  58. google xml sitemap won’t work on directory install
  59. What plugins create a directory on the root directory of WordPress? [closed]
  60. Automating WP application directory creation (domain name passed as a variable argument)
  61. How to disable directory files from accessing?
  62. Move WordPress from Root to Subfolder
  63. WordPress not handling subdirectory properly
  64. Wp-CLI not working with WordPress installed with composer
  65. Does WordPress refer to any files outside of the main install folder (and database)?
  66. WordPress File Structure
  67. Impossible to index an upload folder with 10k files
  68. Moving wordpress from /dir to main folder
  69. Giving WordPress Its Own Directory together with index.html
  70. Upload an image at frontend > Create direction and/or rename filename possible?
  71. wordpress sub-directory sites on a sub-domain?
  72. Trying to setup a dev subdomain, but url loads as /dev/ instead
  73. Want to change my site root
  74. Best way to transfer WordPress install to root of directory when I’m ready to launch?
  75. Hide plugins and theme from public
  76. How to move a WordPress installation to a subdirectory
  77. Is there a way to create folders restricted to specific users to open?
  78. add 360 (non-WordPress) tours in a subfolder with the same name as the main (WordPress)page of the 360 tours
  79. WordPress hosted on subfolder of domain causing customizer to constantly refresh and is requesting jquery from root domain
  80. WordPress Bedrock breaking plugin links
  81. Error in the paths of one of the plugins when changing the plugin directory
  82. Serve WordPress site as root domain with WordPress files in subdirectory in nginx server
  83. Editing Listings in a Business Directory
  84. I need advice for creating native WordPress directory site based on native WordPress functionality only
  85. How to Install WP to Subdomain but Serve on Subdirectory?
  86. Rrestrict access to static pages if user is not logged in
  87. Moving wp-config.php when you have a second wordpress install
  88. How do I get WP site to show in both root and sub-directory
  89. How to replace a wordpress installation in root directory with another in a subdirectory?
  90. Move WordPress with changed name ‘wp-content’
  91. Create Subfolder that always displays template file
  92. Index (Home) page not displayed when running wordpress in a subdirectory
  93. How do you create a development site into a subdirectory of the live site?
  94. Hide/Remove Wp Directory /wp-content/uploads/
  95. The right way to go about creating a WordPress site from a static site which has WordPress installs in its subdirectory
  96. Plugin could not be deleted due to an error: Unable to locate WordPress Plugin directory
  97. Moving wordpress from TLD to sub-folder (URL structure only)
  98. @font-face Paths Don’t Seem to be working properly
  99. Multisite Sub-directories Installation
  100. Could moving my WordPress installation from /var/www/html/ to /var/www/ break the application?
deneme bonusu veren sitelerbahis siteleripulibet girişdeneme bonusutürkçe altyazılı pornocanlı bahis casinocanlı bahis casino siteleriOnwin Güncel Girişholiganbetholiganbet girişholiganbet güncel girişnewsnewsnewsnewsnewsnewsnewsnewsnewsnewsnewsnewsnewsnewsnewsnewsnewsnewsnewsnewsnewsnews