API tools faq
paste
gempir

Untitled

gempir
Jan 8th, 2026
3,779
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.36 KB | None | 0 0
raw download clone embed print report
  1. User-agent: 360Spider
  2. Disallow: /
  3.  
  4. User-agent: Yisouspider
  5. Disallow: /
  6.  
  7. User-agent: PetalBot
  8. Disallow: /
  9.  
  10. User-agent: Bytespider
  11. Disallow: /
  12.  
  13. User-agent: ByteDanceSpider
  14. Disallow: /
  15.  
  16. User-agent: Sogou web spider
  17. Disallow: /
  18.  
  19. User-agent: Sogou inst spider
  20. Disallow: /
  21.  
  22. User-agent: Baiduspider
  23. Disallow: /
  24.  
  25. User-agent: Baiduspider-render
  26. Disallow: /
Advertisement
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!