Advertisement
jdaher

Decryption Project site's robots.txt

May 18th, 2016
176
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.97 KB | None | 0 0
  1. Content-Length: 8
  2. Character-Encoding: us-ascii
  3.  
  4. User-Agent: Megabyte-7
  5. Disallow: /Heart_of_Gold
  6. Disallow: /Karcas_2
  7. Disallow: /Warrior
  8. Disallow: /Bender
  9.  
  10. User-Agent: Half-Gassed-7
  11. Disallow: /Rammstein
  12. Disallow: /Armageddon
  13. Disallow: /Iceberg
  14. Disallow: /Axe_No_Questions
  15.  
  16. User-Agent: The-Crusher-6
  17. Disallow: /Defiant
  18. Disallow: /Stewbot
  19. Disallow: /Backlash
  20. Disallow: /Helichopter
  21.  
  22. User-Agent: Ziggo-6
  23. Disallow: /Code_BLACK
  24. Disallow: /SnowFlake
  25. Disallow: /Shrike
  26. Disallow: /Das_Bot
  27.  
  28. User-Agent: Hammerhead-6
  29. Disallow: /Sublime_II
  30. Disallow: /Paranoid_Android
  31. Disallow: /Harvey_Wallbanger
  32. Disallow: /Beta_Raptor
  33.  
  34. User-Agent: Wedge-of-Doom-6
  35. Disallow: /Wireless_Wonder
  36. Disallow: /Ziggo
  37. Disallow: /Gamma_Raptor
  38. Disallow: /Toe_Crusher
  39.  
  40. User-Agent: Backlash-6
  41. Disallow: /Hexy_Jr
  42. Disallow: /Rampage
  43. Disallow: /Toe_Crusher
  44. Disallow: /JRCV
  45.  
  46. User-Agent: Agsma-6
  47. Disallow: /Die_Fledernaus
  48. Disallow: /Manta
  49. Disallow: /Burning_Metal
  50. Disallow: /Chimera_Mk_II
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement