Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- User-agent: *
- Disallow: /data/*
- Disallow: /files/*
- Disallow: /inc/*
- Disallow: /scripts/*
- Disallow: /search/*
- Disallow: /style/*
- Disallow: /templates/*
- Disallow: /console/*
- Disallow: /*.php*
- Disallow: /*gclid=*
- Disallow: */pno/1/*
- Disallow: */cno/1/*
- Disallow: */cno/*
- Disallow: */sortpro/*
- Disallow: */sor/*kp*kp*
- Disallow: /checkout
- Disallow: /filter*
- Disallow: /*/compare/*
- Disallow: /*/cart/*
- Disallow: /*m=*
- Disallow: *utm_medium=*
- Disallow: *utm_term=*
- # Disallow: /_form/*
- Disallow: /*q=*
- Disallow: *sc_content*
- Disallow: /h?*
- Disallow: /*?f=*
- Disallow: /p/*
- Sitemap: https://stylus.ua/sitemap.xml
- User-agent: SMTBot
- Disallow: /
- User-agent: dotbot
- Disallow: /
- User-agent: ia_archiver
- Disallow: /
- User-agent: CamontSpider
- Disallow: /
- User-agent: cityreview
- Disallow: /
- User-agent: MJ12bot
- Disallow: /
- User-agent: Baiduspider
- Disallow: /
- User-agent: Baiduspider-video
- Disallow: /
- User-agent: Baiduspider-image
- Disallow: /
- User-agent: ScoutJet
- Disallow: /
- User-agent: TurnitinBot
- Disallow: /
- User-agent: ICC-Crawler
- Disallow: /
- User-agent: plukkie
- Disallow: /
- User-agent: discobot
- Disallow: /
- User-agent: NerdByNature.Bot
- Disallow: /
- User-agent: SindiceBot
- Disallow: /
- User-agent: Exabot
- Disallow: /
- User-agent: Aboundexbot
- Disallow: /
- User-agent: archive.org_bot
- Disallow: /
- User-agent: Speedy
- Disallow: /
- User-agent: AhrefsBot
- Disallow: /
- User-agent: 008
- Disallow: /
- User-agent: MJ12bot
- Disallow: /
- User-agent: Linguee
- Disallow: /
- User-agent: 360Spider
- Disallow: /
- User-agent: HaoSouSpider
- Disallow: /
- User-agent: BLEXBot
- Disallow: /
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement