API tools faq
paste
Pecetowicz

My long list of bad bots to block in htaccess, ready to copy

Pecetowicz
Dec 14th, 2023
170
0
Never
1
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 21.15 KB | None | 0 0
raw download clone embed print report
  1. User-agent: 01h4x.com
  2. Disallow:/
  3. User-agent: 360Spider
  4. Disallow:/
  5. User-agent: 404checker
  6. Disallow:/
  7. User-agent: 404enemy
  8. Disallow:/
  9. User-agent: 80legs
  10. Disallow:/
  11. User-agent: Abonti
  12. Disallow:/
  13. User-agent: Aboundex
  14. Disallow:/
  15. User-agent: Aboundexbot
  16. Disallow:/
  17. User-agent: Acunetix
  18. Disallow:/
  19. User-agent: ADmantX
  20. Disallow:/
  21. User-agent: AfD-Verbotsverfahren
  22. Disallow:/
  23. User-agent: AIBOT
  24. Disallow:/
  25. User-agent: AiHitBot
  26. Disallow:/
  27. User-agent: Aipbot
  28. Disallow:/
  29. User-agent: Alexibot
  30. Disallow:/
  31. User-agent: Alligator
  32. Disallow:/
  33. User-agent: AllSubmitter
  34. Disallow:/
  35. User-agent: AlphaBot
  36. Disallow:/
  37. User-agent: Anarchie
  38. Disallow:/
  39. User-agent: Anarchy
  40. Disallow:/
  41. User-agent: Anarchy99
  42. Disallow:/
  43. User-agent: Ankit
  44. Disallow:/
  45. User-agent: Anthill
  46. Disallow:/
  47. User-agent: Apexoo
  48. Disallow:/
  49. User-agent: archive.org_bot
  50. Disallow:/
  51. User-agent: arquivo.pt
  52. Disallow:/
  53. User-agent: arquivo-web-crawler
  54. Disallow:/
  55. User-agent: Aspiegel
  56. Disallow:/
  57. User-agent: ASPSeek
  58. Disallow:/
  59. User-agent: Asterias
  60. Disallow:/
  61. User-agent: Attach
  62. Disallow:/
  63. User-agent: autoemailspider
  64. Disallow:/
  65. User-agent: AwarioRssBot
  66. Disallow:/
  67. User-agent: AwarioSmartBot
  68. Disallow:/
  69. User-agent: BackDoorBot
  70. Disallow:/
  71. User-agent: Backlink-Ceck
  72. Disallow:/
  73. User-agent: backlink-check
  74. Disallow:/
  75. User-agent: BacklinkCrawler
  76. Disallow:/
  77. User-agent: BackStreet
  78. Disallow:/
  79. User-agent: BackWeb
  80. Disallow:/
  81. User-agent: Badass
  82. Disallow:/
  83. User-agent: Bandit
  84. Disallow:/
  85. User-agent: Barkrowler
  86. Disallow:/
  87. User-agent: BatchFTP
  88. Disallow:/
  89. User-agent: Battleztar Bazinga
  90. Disallow:/
  91. User-agent: BBBike
  92. Disallow:/
  93. User-agent: BDCbot
  94. Disallow:/
  95. User-agent: BDFetch
  96. Disallow:/
  97. User-agent: BetaBot
  98. Disallow:/
  99. User-agent: Bigfoot
  100. Disallow:/
  101. User-agent: Bitacle
  102. Disallow:/
  103. User-agent: Blackboard
  104. Disallow:/
  105. User-agent: Black Hole
  106. Disallow:/
  107. User-agent: BlackWidow
  108. Disallow:/
  109. User-agent: BLEXBot
  110. Disallow:/
  111. User-agent: Blow
  112. Disallow:/
  113. User-agent: BlowFish
  114. Disallow:/
  115. User-agent: Boardreader
  116. Disallow:/
  117. User-agent: Bolt
  118. Disallow:/
  119. User-agent: BotALot
  120. Disallow:/
  121. User-agent: Brandprotect
  122. Disallow:/
  123. User-agent: Brandwatch
  124. Disallow:/
  125. User-agent: Buck
  126. Disallow:/
  127. User-agent: Buddy
  128. Disallow:/
  129. User-agent: BuiltBotTough
  130. Disallow:/
  131. User-agent: BuiltWith
  132. Disallow:/
  133. User-agent: Bullseye
  134. Disallow:/
  135. User-agent: BunnySlippers
  136. Disallow:/
  137. User-agent: BuzzSumo
  138. Disallow:/
  139. User-agent: Calculon
  140. Disallow:/
  141. User-agent: CATExplorador
  142. Disallow:/
  143. User-agent: CazoodleBot
  144. Disallow:/
  145. User-agent: CCBot
  146. Disallow:/
  147. User-agent: Cegbfeieh
  148. Disallow:/
  149. User-agent: CensysInspect
  150. Disallow:/
  151. User-agent: check1.exe
  152. Disallow:/
  153. User-agent: CheeseBot
  154. Disallow:/
  155. User-agent: CherryPicker
  156. Disallow:/
  157. User-agent: CheTeam
  158. Disallow:/
  159. User-agent: ChinaClaw
  160. Disallow:/
  161. User-agent: Chlooe
  162. Disallow:/
  163. User-agent: Claritybot
  164. Disallow:/
  165. User-agent: Cliqzbot
  166. Disallow:/
  167. User-agent: Cloud mapping
  168. Disallow:/
  169. User-agent: coccocbot-web
  170. Disallow:/
  171. User-agent: Cocolyzebot
  172. Disallow:/
  173. User-agent: CODE87
  174. Disallow:/
  175. User-agent: Cogentbot
  176. Disallow:/
  177. User-agent: cognitiveseo
  178. Disallow:/
  179. User-agent: Collector
  180. Disallow:/
  181. User-agent: com.plumanalytics
  182. Disallow:/
  183. User-agent: Copier
  184. Disallow:/
  185. User-agent: CopyRightCheck
  186. Disallow:/
  187. User-agent: Copyscape
  188. Disallow:/
  189. User-agent: Cosmos
  190. Disallow:/
  191. User-agent: Craftbot
  192. Disallow:/
  193. User-agent: crawler4j
  194. Disallow:/
  195. User-agent: crawler.feedback
  196. Disallow:/
  197. User-agent: crawl.sogou.com
  198. Disallow:/
  199. User-agent: CrazyWebCrawler
  200. Disallow:/
  201. User-agent: Crescent
  202. Disallow:/
  203. User-agent: CrunchBot
  204. Disallow:/
  205. User-agent: CSHttp
  206. Disallow:/
  207. User-agent: Curious
  208. Disallow:/
  209. User-agent: Custo
  210. Disallow:/
  211. User-agent: CyotekWebCopy
  212. Disallow:/
  213. User-agent: DatabaseDriverMysqli
  214. Disallow:/
  215. User-agent: DataCha0s
  216. Disallow:/
  217. User-agent: DBLBot
  218. Disallow:/
  219. User-agent: demandbase-bot
  220. Disallow:/
  221. User-agent: Demon
  222. Disallow:/
  223. User-agent: Deusu
  224. Disallow:/
  225. User-agent: Devil
  226. Disallow:/
  227. User-agent: Digincore
  228. Disallow:/
  229. User-agent: DigitalPebble
  230. Disallow:/
  231. User-agent: DIIbot
  232. Disallow:/
  233. User-agent: Dirbuster
  234. Disallow:/
  235. User-agent: Disco
  236. Disallow:/
  237. User-agent: Discobot
  238. Disallow:/
  239. User-agent: Discoverybot
  240. Disallow:/
  241. User-agent: Dispatch
  242. Disallow:/
  243. User-agent: DittoSpyder
  244. Disallow:/
  245. User-agent: DnyzBot
  246. Disallow:/
  247. User-agent: DomainAppender
  248. Disallow:/
  249. User-agent: DomainCrawler
  250. Disallow:/
  251. User-agent: DomainSigmaCrawler
  252. Disallow:/
  253. User-agent: Domains Project
  254. Disallow:/
  255. User-agent: domainsproject.org
  256. Disallow:/
  257. User-agent: DomainStatsBot
  258. Disallow:/
  259. User-agent: DomCopBot
  260. Disallow:/
  261. User-agent: Dotbot
  262. Disallow:/
  263. User-agent: Download Wonder
  264. Disallow:/
  265. User-agent: Dragonfly
  266. Disallow:/
  267. User-agent: Drip
  268. Disallow:/
  269. User-agent: DSearch
  270. Disallow:/
  271. User-agent: DTS Agent
  272. Disallow:/
  273. User-agent: EasyDL
  274. Disallow:/
  275. User-agent: Ebingbong
  276. Disallow:/
  277. User-agent: eCatch
  278. Disallow:/
  279. User-agent: ECCP/1.0
  280. Disallow:/
  281. User-agent: Ecxi
  282. Disallow:/
  283. User-agent: EirGrabber
  284. Disallow:/
  285. User-agent: EMail Siphon
  286. Disallow:/
  287. User-agent: EMail Wolf
  288. Disallow:/
  289. User-agent: EroCrawler
  290. Disallow:/
  291. User-agent: evc-batch
  292. Disallow:/
  293. User-agent: Evil
  294. Disallow:/
  295. User-agent: Exabot
  296. Disallow:/
  297. User-agent: Express WebPictures
  298. Disallow:/
  299. User-agent: ExtLinksBot
  300. Disallow:/
  301. User-agent: Extractor
  302. Disallow:/
  303. User-agent: ExtractorPro
  304. Disallow:/
  305. User-agent: Extreme Picture Finder
  306. Disallow:/
  307. User-agent: EyeNetIE
  308. Disallow:/
  309. User-agent: Ezooms
  310. Disallow:/
  311. User-agent: facebookscraper
  312. Disallow:/
  313. User-agent: FDM
  314. Disallow:/
  315. User-agent: FemtosearchBot
  316. Disallow:/
  317. User-agent: FHscan
  318. Disallow:/
  319. User-agent: Fimap
  320. Disallow:/
  321. User-agent: Firefox/7.0
  322. Disallow:/
  323. User-agent: FlashGet
  324. Disallow:/
  325. User-agent: Flunky
  326. Disallow:/
  327. User-agent: Foobot
  328. Disallow:/
  329. User-agent: Freeuploader
  330. Disallow:/
  331. User-agent: FrontPage
  332. Disallow:/
  333. User-agent: Fuzz
  334. Disallow:/
  335. User-agent: FyberSpider
  336. Disallow:/
  337. User-agent: Fyrebot
  338. Disallow:/
  339. User-agent: GalaxyBot
  340. Disallow:/
  341. User-agent: Genieo
  342. Disallow:/
  343. User-agent: GermCrawler
  344. Disallow:/
  345. User-agent: Getintent
  346. Disallow:/
  347. User-agent: GetRight
  348. Disallow:/
  349. User-agent: GetWeb
  350. Disallow:/
  351. User-agent: Gigablast
  352. Disallow:/
  353. User-agent: Gigabot
  354. Disallow:/
  355. User-agent: G-i-g-a-b-o-t
  356. Disallow:/
  357. User-agent: Go-Ahead-Got-It
  358. Disallow:/
  359. User-agent: gopher
  360. Disallow:/
  361. User-agent: Gotit
  362. Disallow:/
  363. User-agent: GoZilla
  364. Disallow:/
  365. User-agent: Go!Zilla
  366. Disallow:/
  367. User-agent: Grabber
  368. Disallow:/
  369. User-agent: GrabNet
  370. Disallow:/
  371. User-agent: Grafula
  372. Disallow:/
  373. User-agent: GrapeFX
  374. Disallow:/
  375. User-agent: GrapeshotCrawler
  376. Disallow:/
  377. User-agent: GridBot
  378. Disallow:/
  379. User-agent: GT::WWW
  380. Disallow:/
  381. User-agent: Haansoft
  382. Disallow:/
  383. User-agent: HaosouSpider
  384. Disallow:/
  385. User-agent: Harvest
  386. Disallow:/
  387. User-agent: Havij
  388. Disallow:/
  389. User-agent: HEADMasterSEO
  390. Disallow:/
  391. User-agent: heritrix
  392. Disallow:/
  393. User-agent: Heritrix
  394. Disallow:/
  395. User-agent: Hloader
  396. Disallow:/
  397. User-agent: HMView
  398. Disallow:/
  399. User-agent: HTMLparser
  400. Disallow:/
  401. User-agent: HTTP::Lite
  402. Disallow:/
  403. User-agent: HTTrack
  404. Disallow:/
  405. User-agent: Humanlinks
  406. Disallow:/
  407. User-agent: HybridBot
  408. Disallow:/
  409. User-agent: Iblog
  410. Disallow:/
  411. User-agent: IDBot
  412. Disallow:/
  413. User-agent: IDBTE4M
  414. Disallow:/
  415. User-agent: Id-search
  416. Disallow:/
  417. User-agent: IlseBot
  418. Disallow:/
  419. User-agent: Image Fetch
  420. Disallow:/
  421. User-agent: Image Sucker
  422. Disallow:/
  423. User-agent: IndeedBot
  424. Disallow:/
  425. User-agent: Indy Library
  426. Disallow:/
  427. User-agent: InfoNaviRobot
  428. Disallow:/
  429. User-agent: InfoTekies
  430. Disallow:/
  431. User-agent: instabid
  432. Disallow:/
  433. User-agent: Intelliseek
  434. Disallow:/
  435. User-agent: InterGET
  436. Disallow:/
  437. User-agent: Internet Ninja
  438. Disallow:/
  439. User-agent: InternetSeer
  440. Disallow:/
  441. User-agent: internetVista monitor
  442. Disallow:/
  443. User-agent: ips-agent
  444. Disallow:/
  445. User-agent: Iria
  446. Disallow:/
  447. User-agent: IRLbot
  448. Disallow:/
  449. User-agent: isitwp.com
  450. Disallow:/
  451. User-agent: Iskanie
  452. Disallow:/
  453. User-agent: IstellaBot
  454. Disallow:/
  455. User-agent: JamesBOT
  456. Disallow:/
  457. User-agent: Jbrofuzz
  458. Disallow:/
  459. User-agent: JennyBot
  460. Disallow:/
  461. User-agent: JetCar
  462. Disallow:/
  463. User-agent: Jetty
  464. Disallow:/
  465. User-agent: JikeSpider
  466. Disallow:/
  467. User-agent: JOC Web Spider
  468. Disallow:/
  469. User-agent: Joomla
  470. Disallow:/
  471. User-agent: Jorgee
  472. Disallow:/
  473. User-agent: JustView
  474. Disallow:/
  475. User-agent: Jyxobot
  476. Disallow:/
  477. User-agent: Kenjin Spider
  478. Disallow:/
  479. User-agent: Keyword Density
  480. Disallow:/
  481. User-agent: Kinza
  482. Disallow:/
  483. User-agent: Kozmosbot
  484. Disallow:/
  485. User-agent: Lanshanbot
  486. Disallow:/
  487. User-agent: Larbin
  488. Disallow:/
  489. User-agent: LeechFTP
  490. Disallow:/
  491. User-agent: LeechGet
  492. Disallow:/
  493. User-agent: LexiBot
  494. Disallow:/
  495. User-agent: Lftp
  496. Disallow:/
  497. User-agent: LibWeb
  498. Disallow:/
  499. User-agent: Libwhisker
  500. Disallow:/
  501. User-agent: LieBaoFast
  502. Disallow:/
  503. User-agent: Lightspeedsystems
  504. Disallow:/
  505. User-agent: Likse
  506. Disallow:/
  507. User-agent: Linkbot
  508. Disallow:/
  509. User-agent: Linkdexbot
  510. Disallow:/
  511. User-agent: LinkextractorPro
  512. Disallow:/
  513. User-agent: LinkpadBot
  514. Disallow:/
  515. User-agent: LinkScan
  516. Disallow:/
  517. User-agent: LinksManager
  518. Disallow:/
  519. User-agent: LinkWalker
  520. Disallow:/
  521. User-agent: LinqiaMetadataDownloaderBot
  522. Disallow:/
  523. User-agent: LinqiaRSSBot
  524. Disallow:/
  525. User-agent: LinqiaScrapeBot
  526. Disallow:/
  527. User-agent: Lipperhey
  528. Disallow:/
  529. User-agent: Lipperhey Spider
  530. Disallow:/
  531. User-agent: Litemage_walker
  532. Disallow:/
  533. User-agent: Lmspider
  534. Disallow:/
  535. User-agent: LNSpiderguy
  536. Disallow:/
  537. User-agent: Ltx71
  538. Disallow:/
  539. User-agent: lwp-request
  540. Disallow:/
  541. User-agent: LWP::Simple
  542. Disallow:/
  543. User-agent: lwp-trivial
  544. Disallow:/
  545. User-agent: Magnet
  546. Disallow:/
  547. User-agent: Mag-Net
  548. Disallow:/
  549. User-agent: magpie-crawler
  550. Disallow:/
  551. User-agent: Mail.RU_Bot
  552. Disallow:/
  553. User-agent: Majestic12
  554. Disallow:/
  555. User-agent: Majestic SEO
  556. Disallow:/
  557. User-agent: Majestic-SEO
  558. Disallow:/
  559. User-agent: MarkMonitor
  560. Disallow:/
  561. User-agent: MarkWatch
  562. Disallow:/
  563. User-agent: Masscan
  564. Disallow:/
  565. User-agent: Mass Downloader
  566. Disallow:/
  567. User-agent: Mata Hari
  568. Disallow:/
  569. User-agent: MauiBot
  570. Disallow:/
  571. User-agent: Mb2345Browser
  572. Disallow:/
  573. User-agent: meanpathbot
  574. Disallow:/
  575. User-agent: Meanpathbot
  576. Disallow:/
  577. User-agent: MeanPath Bot
  578. Disallow:/
  579. User-agent: Mediatoolkitbot
  580. Disallow:/
  581. User-agent: mediawords
  582. Disallow:/
  583. User-agent: MegaIndex.ru
  584. Disallow:/
  585. User-agent: Metauri
  586. Disallow:/
  587. User-agent: MFC_Tear_Sample
  588. Disallow:/
  589. User-agent: MicroMessenger
  590. Disallow:/
  591. User-agent: Microsoft Data Access
  592. Disallow:/
  593. User-agent: Microsoft URL Control
  594. Disallow:/
  595. User-agent: MIDown tool
  596. Disallow:/
  597. User-agent: MIIxpc
  598. Disallow:/
  599. User-agent: Mister PiX
  600. Disallow:/
  601. User-agent: MJ12bot
  602. Disallow:/
  603. User-agent: Mojeek
  604. Disallow:/
  605. User-agent: Mojolicious
  606. Disallow:/
  607. User-agent: Morfeus Fucking Scanner
  608. Disallow:/
  609. User-agent: Mozlila
  610. Disallow:/
  611. User-agent: MQQBrowser
  612. Disallow:/
  613. User-agent: Mr.4x3
  614. Disallow:/
  615. User-agent: MSFrontPage
  616. Disallow:/
  617. User-agent: MSIECrawler
  618. Disallow:/
  619. User-agent: Msrabot
  620. Disallow:/
  621. User-agent: MTRobot
  622. Disallow:/
  623. User-agent: muhstik-scan
  624. Disallow:/
  625. User-agent: Musobot
  626. Disallow:/
  627. User-agent: Name Intelligence
  628. Disallow:/
  629. User-agent: Nameprotect
  630. Disallow:/
  631. User-agent: Navroad
  632. Disallow:/
  633. User-agent: NearSite
  634. Disallow:/
  635. User-agent: Needle
  636. Disallow:/
  637. User-agent: Nessus
  638. Disallow:/
  639. User-agent: NetAnts
  640. Disallow:/
  641. User-agent: Netcraft
  642. Disallow:/
  643. User-agent: netEstate NE Crawler
  644. Disallow:/
  645. User-agent: NetLyzer
  646. Disallow:/
  647. User-agent: NetMechanic
  648. Disallow:/
  649. User-agent: NetSpider
  650. Disallow:/
  651. User-agent: Nettrack
  652. Disallow:/
  653. User-agent: Net Vampire
  654. Disallow:/
  655. User-agent: Netvibes
  656. Disallow:/
  657. User-agent: NetZIP
  658. Disallow:/
  659. User-agent: NextGenSearchBot
  660. Disallow:/
  661. User-agent: Nibbler
  662. Disallow:/
  663. User-agent: NICErsPRO
  664. Disallow:/
  665. User-agent: Niki-bot
  666. Disallow:/
  667. User-agent: Nikto
  668. Disallow:/
  669. User-agent: NimbleCrawler
  670. Disallow:/
  671. User-agent: Nimbostratus
  672. Disallow:/
  673. User-agent: Ninja
  674. Disallow:/
  675. User-agent: Nmap
  676. Disallow:/
  677. User-agent: NPbot
  678. Disallow:/
  679. User-agent: Nuclei
  680. Disallow:/
  681. User-agent: Nutch
  682. Disallow:/
  683. User-agent: oBot
  684. Disallow:/
  685. User-agent: Octopus
  686. Disallow:/
  687. User-agent: Offline Explorer
  688. Disallow:/
  689. User-agent: Offline Navigator
  690. Disallow:/
  691. User-agent: OnCrawl
  692. Disallow:/
  693. User-agent: Openfind
  694. Disallow:/
  695. User-agent: OpenLinkProfiler
  696. Disallow:/
  697. User-agent: Openvas
  698. Disallow:/
  699. User-agent: OpenVAS
  700. Disallow:/
  701. User-agent: OPPO A33
  702. Disallow:/
  703. User-agent: OrangeBot
  704. Disallow:/
  705. User-agent: OrangeSpider
  706. Disallow:/
  707. User-agent: OutclicksBot
  708. Disallow:/
  709. User-agent: OutfoxBot
  710. Disallow:/
  711. User-agent: PageAnalyzer
  712. Disallow:/
  713. User-agent: Page Analyzer
  714. Disallow:/
  715. User-agent: PageGrabber
  716. Disallow:/
  717. User-agent: page scorer
  718. Disallow:/
  719. User-agent: PageScorer
  720. Disallow:/
  721. User-agent: PageThing.com
  722. Disallow:/
  723. User-agent: Pandalytics
  724. Disallow:/
  725. User-agent: Panscient
  726. Disallow:/
  727. User-agent: Papa Foto
  728. Disallow:/
  729. User-agent: Pavuk
  730. Disallow:/
  731. User-agent: pcBrowser
  732. Disallow:/
  733. User-agent: PECL::HTTP
  734. Disallow:/
  735. User-agent: PeoplePal
  736. Disallow:/
  737. User-agent: Petalbot
  738. Disallow:/
  739. User-agent: PHPCrawl
  740. Disallow:/
  741. User-agent: Picscout
  742. Disallow:/
  743. User-agent: Picsearch
  744. Disallow:/
  745. User-agent: PictureFinder
  746. Disallow:/
  747. User-agent: Piepmatz
  748. Disallow:/
  749. User-agent: Pimonster
  750. Disallow:/
  751. User-agent: Pi-Monster
  752. Disallow:/
  753. User-agent: Pixray
  754. Disallow:/
  755. User-agent: PleaseCrawl
  756. Disallow:/
  757. User-agent: plumanalytics
  758. Disallow:/
  759. User-agent: Pockey
  760. Disallow:/
  761. User-agent: POE-Component-Client-HTTP
  762. Disallow:/
  763. User-agent: polaris version
  764. Disallow:/
  765. User-agent: probe-image-size
  766. Disallow:/
  767. User-agent: Probethenet
  768. Disallow:/
  769. User-agent: ProPowerBot
  770. Disallow:/
  771. User-agent: ProWebWalker
  772. Disallow:/
  773. User-agent: Psbot
  774. Disallow:/
  775. User-agent: Pu_iN
  776. Disallow:/
  777. User-agent: Pump
  778. Disallow:/
  779. User-agent: PxBroker
  780. Disallow:/
  781. User-agent: PyCurl
  782. Disallow:/
  783. User-agent: QueryN Metasearch
  784. Disallow:/
  785. User-agent: Quick-Crawler
  786. Disallow:/
  787. User-agent: RankActive
  788. Disallow:/
  789. User-agent: RankActiveLinkBot
  790. Disallow:/
  791. User-agent: RankFlex
  792. Disallow:/
  793. User-agent: RankingBot
  794. Disallow:/
  795. User-agent: RankingBot2
  796. Disallow:/
  797. User-agent: Rankivabot
  798. Disallow:/
  799. User-agent: RankurBot
  800. Disallow:/
  801. User-agent: RealDownload
  802. Disallow:/
  803. User-agent: Reaper
  804. Disallow:/
  805. User-agent: RebelMouse
  806. Disallow:/
  807. User-agent: Recorder
  808. Disallow:/
  809. User-agent: RedesScrapy
  810. Disallow:/
  811. User-agent: ReGet
  812. Disallow:/
  813. User-agent: RepoMonkey
  814. Disallow:/
  815. User-agent: Re-re
  816. Disallow:/
  817. User-agent: Ripper
  818. Disallow:/
  819. User-agent: ripz
  820. Disallow:/
  821. User-agent: RocketCrawler
  822. Disallow:/
  823. User-agent: Rogerbot
  824. Disallow:/
  825. User-agent: RSSingBot
  826. Disallow:/
  827. User-agent: s1z.ru
  828. Disallow:/
  829. User-agent: SalesIntelligent
  830. Disallow:/
  831. User-agent: satoristudio.net
  832. Disallow:/
  833. User-agent: SBIder
  834. Disallow:/
  835. User-agent: scalaj-http
  836. Disallow:/
  837. User-agent: ScanAlert
  838. Disallow:/
  839. User-agent: Scanbot
  840. Disallow:/
  841. User-agent: scan.lol
  842. Disallow:/
  843. User-agent: ScoutJet
  844. Disallow:/
  845. User-agent: Scrapy
  846. Disallow:/
  847. User-agent: Screaming
  848. Disallow:/
  849. User-agent: ScreenerBot
  850. Disallow:/
  851. User-agent: Searchestate
  852. Disallow:/
  853. User-agent: SearchmetricsBot
  854. Disallow:/
  855. User-agent: Semrush
  856. Disallow:/
  857. User-agent: SemrushBot
  858. Disallow:/
  859. User-agent: SentiBot
  860. Disallow:/
  861. User-agent: seobility
  862. Disallow:/
  863. User-agent: SeobilityBot
  864. Disallow:/
  865. User-agent: SEOkicks
  866. Disallow:/
  867. User-agent: SEOkicks-Robot
  868. Disallow:/
  869. User-agent: SEOlyticsCrawler
  870. Disallow:/
  871. User-agent: Seomoz
  872. Disallow:/
  873. User-agent: SEOprofiler
  874. Disallow:/
  875. User-agent: seoscanners
  876. Disallow:/
  877. User-agent: SeoSiteCheckup
  878. Disallow:/
  879. User-agent: SEOstats
  880. Disallow:/
  881. User-agent: serpstatbot
  882. Disallow:/
  883. User-agent: sexsearcher
  884. Disallow:/
  885. User-agent: Shodan
  886. Disallow:/
  887. User-agent: Siphon
  888. Disallow:/
  889. User-agent: SISTRIX
  890. Disallow:/
  891. User-agent: Sitebeam
  892. Disallow:/
  893. User-agent: SiteCheckerBotCrawler
  894. Disallow:/
  895. User-agent: sitechecker.pro
  896. Disallow:/
  897. User-agent: SiteExplorer
  898. Disallow:/
  899. User-agent: Siteimprove
  900. Disallow:/
  901. User-agent: SiteLockSpider
  902. Disallow:/
  903. User-agent: siteripz
  904. Disallow:/
  905. User-agent: SiteSnagger
  906. Disallow:/
  907. User-agent: SiteSucker
  908. Disallow:/
  909. User-agent: Site Sucker
  910. Disallow:/
  911. User-agent: Sitevigil
  912. Disallow:/
  913. User-agent: SlySearch
  914. Disallow:/
  915. User-agent: SmartDownload
  916. Disallow:/
  917. User-agent: SMTBot
  918. Disallow:/
  919. User-agent: Snake
  920. Disallow:/
  921. User-agent: Snapbot
  922. Disallow:/
  923. User-agent: Snoopy
  924. Disallow:/
  925. User-agent: SocialRankIOBot
  926. Disallow:/
  927. User-agent: Sociscraper
  928. Disallow:/
  929. User-agent: sogouspider
  930. Disallow:/
  931. User-agent: Sogou web spider
  932. Disallow:/
  933. User-agent: Sosospider
  934. Disallow:/
  935. User-agent: Sottopop
  936. Disallow:/
  937. User-agent: SpaceBison
  938. Disallow:/
  939. User-agent: Spammen
  940. Disallow:/
  941. User-agent: SpankBot
  942. Disallow:/
  943. User-agent: Spanner
  944. Disallow:/
  945. User-agent: sp_auditbot
  946. Disallow:/
  947. User-agent: Spbot
  948. Disallow:/
  949. User-agent: Spinn3r
  950. Disallow:/
  951. User-agent: SputnikBot
  952. Disallow:/
  953. User-agent: spyfu
  954. Disallow:/
  955. User-agent: Sqlmap
  956. Disallow:/
  957. User-agent: Sqlworm
  958. Disallow:/
  959. User-agent: Sqworm
  960. Disallow:/
  961. User-agent: Steeler
  962. Disallow:/
  963. User-agent: Stripper
  964. Disallow:/
  965. User-agent: Sucker
  966. Disallow:/
  967. User-agent: Sucuri
  968. Disallow:/
  969. User-agent: SuperBot
  970. Disallow:/
  971. User-agent: SuperHTTP
  972. Disallow:/
  973. User-agent: Surfbot
  974. Disallow:/
  975. User-agent: SurveyBot
  976. Disallow:/
  977. User-agent: Suzuran
  978. Disallow:/
  979. User-agent: Swiftbot
  980. Disallow:/
  981. User-agent: sysscan
  982. Disallow:/
  983. User-agent: Szukacz
  984. Disallow:/
  985. User-agent: T0PHackTeam
  986. Disallow:/
  987. User-agent: T8Abot
  988. Disallow:/
  989. User-agent: tAkeOut
  990. Disallow:/
  991. User-agent: Teleport
  992. Disallow:/
  993. User-agent: TeleportPro
  994. Disallow:/
  995. User-agent: Telesoft
  996. Disallow:/
  997. User-agent: Telesphoreo
  998. Disallow:/
  999. User-agent: Telesphorep
  1000. Disallow:/
  1001. User-agent: The Intraformant
  1002. Disallow:/
  1003. User-agent: TheNomad
  1004. Disallow:/
  1005. User-agent: Thumbor
  1006. Disallow:/
  1007. User-agent: TightTwatBot
  1008. Disallow:/
  1009. User-agent: Titan
  1010. Disallow:/
  1011. User-agent: Toata
  1012. Disallow:/
  1013. User-agent: Toweyabot
  1014. Disallow:/
  1015. User-agent: Tracemyfile
  1016. Disallow:/
  1017. User-agent: Trendiction
  1018. Disallow:/
  1019. User-agent: Trendictionbot
  1020. Disallow:/
  1021. User-agent: trendiction.com
  1022. Disallow:/
  1023. User-agent: trendiction.de
  1024. Disallow:/
  1025. User-agent: True_Robot
  1026. Disallow:/
  1027. User-agent: Turingos
  1028. Disallow:/
  1029. User-agent: Turnitin
  1030. Disallow:/
  1031. User-agent: TurnitinBot
  1032. Disallow:/
  1033. User-agent: TwengaBot
  1034. Disallow:/
  1035. User-agent: Twice
  1036. Disallow:/
  1037. User-agent: Typhoeus
  1038. Disallow:/
  1039. User-agent: UnisterBot
  1040. Disallow:/
  1041. User-agent: Upflow
  1042. Disallow:/
  1043. User-agent: URLy Warning
  1044. Disallow:/
  1045. User-agent: URLy.Warning
  1046. Disallow:/
  1047. User-agent: Vacuum
  1048. Disallow:/
  1049. User-agent: Vagabondo
  1050. Disallow:/
  1051. User-agent: VB Project
  1052. Disallow:/
  1053. User-agent: VCI
  1054. Disallow:/
  1055. User-agent: VelenPublicWebCrawler
  1056. Disallow:/
  1057. User-agent: VeriCiteCrawler
  1058. Disallow:/
  1059. User-agent: VidibleScraper
  1060. Disallow:/
  1061. User-agent: Virusdie
  1062. Disallow:/
  1063. User-agent: VoidEYE
  1064. Disallow:/
  1065. User-agent: Voil
  1066. Disallow:/
  1067. User-agent: Voltron
  1068. Disallow:/
  1069. User-agent: Wallpapers/3.0
  1070. Disallow:/
  1071. User-agent: WallpapersHD
  1072. Disallow:/
  1073. User-agent: WASALive-Bot
  1074. Disallow:/
  1075. User-agent: WBSearchBot
  1076. Disallow:/
  1077. User-agent: Webalta
  1078. Disallow:/
  1079. User-agent: WebAuto
  1080. Disallow:/
  1081. User-agent: Web Auto
  1082. Disallow:/
  1083. User-agent: WebBandit
  1084. Disallow:/
  1085. User-agent: WebCollage
  1086. Disallow:/
  1087. User-agent: Web Collage
  1088. Disallow:/
  1089. User-agent: WebCopier
  1090. Disallow:/
  1091. User-agent: WEBDAV
  1092. Disallow:/
  1093. User-agent: WebEnhancer
  1094. Disallow:/
  1095. User-agent: Web Enhancer
  1096. Disallow:/
  1097. User-agent: WebFetch
  1098. Disallow:/
  1099. User-agent: Web Fetch
  1100. Disallow:/
  1101. User-agent: WebFuck
  1102. Disallow:/
  1103. User-agent: Web Fuck
  1104. Disallow:/
  1105. User-agent: WebGo IS
  1106. Disallow:/
  1107. User-agent: WebImageCollector
  1108. Disallow:/
  1109. User-agent: WebLeacher
  1110. Disallow:/
  1111. User-agent: WebmasterWorldForumBot
  1112. Disallow:/
  1113. User-agent: webmeup-crawler
  1114. Disallow:/
  1115. User-agent: WebPix
  1116. Disallow:/
  1117. User-agent: Web Pix
  1118. Disallow:/
  1119. User-agent: WebReaper
  1120. Disallow:/
  1121. User-agent: WebSauger
  1122. Disallow:/
  1123. User-agent: Web Sauger
  1124. Disallow:/
  1125. User-agent: Webshag
  1126. Disallow:/
  1127. User-agent: WebsiteExtractor
  1128. Disallow:/
  1129. User-agent: WebsiteQuester
  1130. Disallow:/
  1131. User-agent: Website Quester
  1132. Disallow:/
  1133. User-agent: Webster
  1134. Disallow:/
  1135. User-agent: WebStripper
  1136. Disallow:/
  1137. User-agent: WebSucker
  1138. Disallow:/
  1139. User-agent: Web Sucker
  1140. Disallow:/
  1141. User-agent: WebWhacker
  1142. Disallow:/
  1143. User-agent: WebZIP
  1144. Disallow:/
  1145. User-agent: WeSEE
  1146. Disallow:/
  1147. User-agent: Whack
  1148. Disallow:/
  1149. User-agent: Whacker
  1150. Disallow:/
  1151. User-agent: Whatweb
  1152. Disallow:/
  1153. User-agent: Who.is Bot
  1154. Disallow:/
  1155. User-agent: Widow
  1156. Disallow:/
  1157. User-agent: WinHTTrack
  1158. Disallow:/
  1159. User-agent: WiseGuys Robot
  1160. Disallow:/
  1161. User-agent: WISENutbot
  1162. Disallow:/
  1163. User-agent: Wonderbot
  1164. Disallow:/
  1165. User-agent: Woobot
  1166. Disallow:/
  1167. User-agent: Wotbox
  1168. Disallow:/
  1169. User-agent: Wprecon
  1170. Disallow:/
  1171. User-agent: WPScan
  1172. Disallow:/
  1173. User-agent: WWW-Collector-E
  1174. Disallow:/
  1175. User-agent: WWW-Mechanize
  1176. Disallow:/
  1177. User-agent: WWW::Mechanize
  1178. Disallow:/
  1179. User-agent: WWWOFFLE
  1180. Disallow:/
  1181. User-agent: x09Mozilla
  1182. Disallow:/
  1183. User-agent: x22Mozilla
  1184. Disallow:/
  1185. User-agent: Xaldon WebSpider
  1186. Disallow:/
  1187. User-agent: Xaldon_WebSpider
  1188. Disallow:/
  1189. User-agent: Xenu
  1190. Disallow:/
  1191. User-agent: xpymep1.exe
  1192. Disallow:/
  1193. User-agent: YoudaoBot
  1194. Disallow:/
  1195. User-agent: Zade
  1196. Disallow:/
  1197. User-agent: Zauba
  1198. Disallow:/
  1199. User-agent: zauba.io
  1200. Disallow:/
  1201. User-agent: Zermelo
  1202. Disallow:/
  1203. User-agent: Zeus
  1204. Disallow:/
  1205. User-agent: zgrab
  1206. Disallow:/
  1207. User-agent: Zitebot
  1208. Disallow:/
  1209. User-agent: ZmEu
  1210. Disallow:/
  1211. User-agent: ZoomBot
  1212. Disallow:/
  1213. User-agent: ZoominfoBot
  1214. Disallow:/
  1215. User-agent: ZumBot
  1216. Disallow:/
  1217. User-agent: ZyBorg
  1218. Disallow:/
  1219. User-agent: nekstbot
  1220. Disallow:/
  1221.  
Tags: Bots crawlers
Comments
  • Pecetowicz
    Pecetowicz
    2 years
    # text 1.60 KB | 0 0
    view report reply
    1. ██▓███ ▓█████ ▄████▄ ▓█████▄▄▄█████▓ ▒█████ █ █░ ██▓ ▄████▄ ▒███████▒
    2. ▓██░ ██▒▓█ ▀ ▒██▀ ▀█ ▓█ ▀▓ ██▒ ▓▒▒██▒ ██▒▓█░ █ ░█░▓██▒▒██▀ ▀█ ▒ ▒ ▒ ▄▀░
    3. ▓██░ ██▓▒▒███ ▒▓█ ▄ ▒███ ▒ ▓██░ ▒░▒██░ ██▒▒█░ █ ░█ ▒██▒▒▓█ ▄ ░ ▒ ▄▀▒░
    4. ▒██▄█▓▒ ▒▒▓█ ▄ ▒▓▓▄ ▄██▒▒▓█ ▄░ ▓██▓ ░ ▒██ ██░░█░ █ ░█ ░██░▒▓▓▄ ▄██▒ ▄▀▒ ░
    5. ▒██▒ ░ ░░▒████▒▒ ▓███▀ ░░▒████▒ ▒██▒ ░ ░ ████▓▒░░░██▒██▓ ░██░▒ ▓███▀ ░▒███████▒
    6. ▒▓▒░ ░ ░░░ ▒░ ░░ ░▒ ▒ ░░░ ▒░ ░ ▒ ░░ ░ ▒░▒░▒░ ░ ▓░▒ ▒ ░▓ ░ ░▒ ▒ ░░▒▒ ▓░▒░▒
    7. ░▒ ░ ░ ░ ░ ░ ▒ ░ ░ ░ ░ ░ ▒ ▒░ ▒ ░ ░ ▒ ░ ░ ▒ ░░▒ ▒ ░ ▒
    8. ░░ ░ ░ ░ ░ ░ ░ ░ ▒ ░ ░ ▒ ░░ ░ ░ ░ ░ ░
    9. ░ ░░ ░ ░ ░ ░ ░ ░ ░ ░ ░ ░ ░
    10. ░ ░ ░
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!