API tools faq
paste
lyfsy

robots.txt - a PBN Footprint?

lyfsy
Feb 23rd, 2020
194
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 2.42 KB | None | 0 0
raw download clone embed print report
  1. robots.txt - a PBN Footprint?
  2. So recently I got a bunch of PBNs (around 200) and what I've noticed is that the previous owner of the network copypasted robots.txt file on each and every one of those. Some of those sites already show positive impact on tests and I was wondering whether it is safe to link them to my money site, or should I change robots in order not to harm the money site?
  3. ++++++++++++++
  4. list of top cheapest host http://Listfreetop.pw
  5.  
  6. Top 200 best traffic exchange sites http://Listfreetop.pw
  7.  
  8. free link exchange sites list http://Listfreetop.pw
  9. list of top ptc sites
  10. list of top ptp sites
  11. Listfreetop.pw
  12. Listfreetop.pw
  13. +++++++++++++++
  14.  
  15. The robots.txt looks like this:
  16.  
  17. User-agent: *
  18. Disallow: /wp-admin/
  19. Allow: /wp-admin/admin-ajax.php
  20. User-agent: AhrefsBot
  21. Disallow: /
  22.  
  23. User-agent: MJ12bot
  24. Disallow: /
  25.  
  26. User-agent: Rogerbot
  27. Disallow: /
  28.  
  29. User-agent: SemrushBot
  30. Disallow: /
  31.  
  32. User-agent: ia_archiver
  33. Disallow: /
  34.  
  35. User-agent: ScoutJet
  36. Disallow: /
  37.  
  38. User-agent: sistrix
  39. Disallow: /
  40.  
  41. User-agent: SearchmetricsBot
  42. Disallow: /
  43.  
  44. User-agent: SEOkicks-Robot
  45. Disallow: /
  46.  
  47. User-agent: Lipperhey Spider
  48. Disallow: /
  49.  
  50. User-agent: Exabot
  51. Disallow: /
  52.  
  53. User-agent: NCBot
  54. Disallow: /
  55.  
  56. User-agent: BacklinkCrawler
  57. Disallow: /
  58.  
  59. User-agent: archive.org_bot
  60. Disallow: /
  61.  
  62. User-agent: meanpathbot
  63. Disallow: /
  64.  
  65. User-agent: PagesInventory
  66. Disallow: /
  67.  
  68. User-agent: Aboundexbot
  69. Disallow: /
  70.  
  71. User-agent: spbot
  72. Disallow: /
  73.  
  74. User-agent: linkdexbot
  75. Disallow: /
  76.  
  77. User-agent: Gigabot
  78. Disallow: /
  79.  
  80. User-agent: dotbot
  81. Disallow: /
  82.  
  83. User-agent: Nutch
  84. Disallow: /
  85.  
  86. User-agent: BLEXBot
  87. Disallow: /
  88.  
  89. User-agent: Ezooms
  90. Disallow: /
  91.  
  92. User-agent: Majestic-12
  93. Disallow: /
  94.  
  95. User-agent: Majestic-SEO
  96. Disallow: /
  97.  
  98. User-agent: DSearch
  99. Disallow: /
  100.  
  101. User-agent: MJ12
  102. Disallow: /
  103.  
  104. User-agent: BlekkoBot
  105. Disallow: /
  106.  
  107. User-agent: NerdyBot
  108. Disallow: /
  109.  
  110. User-agent: JamesBOT
  111. Disallow: /
  112.  
  113. User-agent: TinEye
  114. Disallow: /
  115.  
  116. User-agent: Baiduspider
  117. Disallow: /
  118.  
  119. User-agent: serpstat
  120. Disallow: /
  121.  
  122. User-agent: spyfu
  123. Disallow: /
  124. No, I don't think these are footprints, instead, Google may implement much more advanced AI learning model to detect the "patterns" and decide which domain should de-valued, don't overthink too much I guess.
  125.  
  126. faucetcollector.com
  127. earnfreebitcoins.com
  128. bloghi.com
  129. ll cool j hosting
  130. 9 ways to make money
  131. gta v make money single player
  132. freeweb.me
  133. hosting 24 coupon code
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!