Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- User-agent: *
- Disallow: /wp-admin/
- User-agent: AhrefsBot
- Disallow: /
- User-agent: spbot
- Disallow: /
- User-agent: BLEXbot
- Disallow: /
- User-agent: Blekkobot
- Disallow: /
- User-agent: SEOkicks-Robot
- Disallow: /
- User-agent: Gigabot
- Disallow: /
- User-agent: DotBot
- Disallow: /
- User-agent: MJ12bot
- Disallow: /
- User-agent: Exabot
- Disallow: /
- User-agent: rogerbot
- Disallow: /
- User-agent: 008
- Disallow: /
- User-agent: metajobbot
- Disallow: /
- User-agent: Ezooms
- Disallow: /
- User-agent: fyberspider
- Disallow: /
- User-agent: dotbot
- Disallow: /
- User-agent: MojeekBot
- Disallow: /
- User-agent: Baiduspider
- Disallow: /
- #Baiduspider
- User-agent: Baiduspider
- Disallow: /
- User-agent: Baiduspider+
- Disallow: /
- User-agent: Baiduspider+(+http://www.baidu.com/search/spider.htm)
- Disallow: /
- User-agent: Baiduspider/2.0; +http://www.baidu.com/search/spider.html
- Disallow: /
- User-agent: Baiduspider/2.0
- Disallow: /
- User-agent: +Baiduspider
- Disallow: /
- User-agent: +Baiduspider/2.0
- Disallow: /
- User-agent: +Baiduspider/2.0;++http://www.baidu.com/search/spider.html
- Disallow: /
- User-agent: Mozilla/5.0(compatible;Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
- Disallow: /
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement