Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- [root@zolto logs]# grep -i "Googlebot" 20170924
- 66.249.64.8 - - [23/Sep/2017:07:46:21 +0300] "GET / HTTP/1.0" 404 13915 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
- 66.249.64.6 - - [23/Sep/2017:08:58:55 +0300] "GET /robots.txt HTTP/1.0" 404 8015 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
- 66.249.64.8 - - [23/Sep/2017:14:53:37 +0300] "GET / HTTP/1.0" 404 13915 "-" "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
- 66.249.69.22 - - [23/Sep/2017:20:00:21 +0300] "GET / HTTP/1.0" 404 13915 "http://away.vk.com/away.php" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
- 66.249.69.22 - - [23/Sep/2017:22:07:28 +0300] "GET /robots.txt HTTP/1.0" 404 8015 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
- 66.249.69.20 - - [23/Sep/2017:22:07:28 +0300] "GET / HTTP/1.0" 404 13915 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
