Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- # robots.txt file for http://www.XXXXXXXXXXXXXXXX.com/
- sitemap: http://www.XXXXXXXXXXXXXXXXXXXXX.com/sitemap.xml
- User-agent: *
- # disallow all files in these directories
- Disallow: /cgi-bin/
- Disallow: /wp-admin/
- Disallow: /wp-includes/
- Disallow: /wp-content/
- Disallow: /go/
- Disallow: /archives/
- disallow: /*?*
- Disallow: /wp-*
- Disallow: /author
- Disallow: /comments/feed/
- Allow: /
- Disallow: /search/
- Disallow: /tags/
- User-agent: Mediapartners-Google*
- Allow: /
- User-agent: Googlebot-Image
- Allow: /wp-content/uploads/
- User-agent: Adsbot-Google
- Allow: /
- User-agent: Googlebot-Mobile
- Allow: /
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement