Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- /robots.txt: Robots file
- | /sdk/%2E%2E/%2E%2E/%2E%2E/%2E%2E/%2E%2E/%2E%2E/%2E%2E/etc/vmware/hostd/vmInventory.xml: Possible path traversal in VMWare (CVE-2009-3733)
- | /wp-includes/js/scriptaculous/sound.js: Wordpress version 2.3 found.
- | /wp-includes/js/jquery/suggest.js: Wordpress version 2.5 found.
- | /wp-includes/js/comment-reply.js: Wordpress version 2.7 found.
- | /wp-includes/js/codepress/codepress.js: Wordpress version 2.8 found.
- |_ /sitecore/shell/sitecore.version.xml: Sitecore.NET login page
- User-agent: Googlebot
- Allow: /?_escaped_fragment_
- Allow: /*?lang=
- Allow: /hashtag/*?src=
- Allow: /search?q=%23
- Allow: /i/api/
- Disallow: /search/realtime
- Disallow: /search/users
- Disallow: /search/*/grid
- Allow: /*?ref_src=
- Allow: /*?src=
- Disallow: /*?
- Disallow: /*/followers
- Disallow: /*/following
- Disallow: /account/deactivated
- Disallow: /settings/deactivated
- # Every bot that might possibly read and respect this file
- # ========================================================
- User-agent: *
- Disallow: /
- # WHAT-4882 - Block indexing of links in notification emails. This applies to all bots.
- # =====================================================================================
- Disallow: /i/u
- Noindex: /i/u
- # Wait 1 second between successive requests. See ONBOARD-2698 for details.
- Crawl-delay: 1
- # Independent of user agent. Links in the sitemap are full URLs using https:// and need to match
- # the protocol of the sitemap.
- Sitemap: https://twitter.com/sitemap.xml
Advertisement
Add Comment
Please, Sign In to add comment
