fant0men

Mirror a website with wget (for local viewing)

Aug 12th, 2020 (edited)
240
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.76 KB | None | 0 0
  1. wget --mirror --convert-links --waitretry=10 --tries=inf undocumented.ntinternals.net
  2.  
  3. wget -mpHkxKE -e robots=off --waitretry=10 --tries=inf https://secure2.linuxjournal.com/ljarchive/
  4.  
  5. ***
  6.  
  7. wget -mpHkxKE -e robots=off --waitretry=10 --tries=inf --no-cookies --random-wait --no-check-certificate --no-clobber --user-agent='Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.105 Safari/537.36' undocumented.ntinternals.net
  8.  
  9. ***
  10. page=0; for n in {1..45}; do wget -EHkp -e robots=off --waitretry=10 --tries=10 --user-agent='Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.105 Safari/537.36' "www.betaarchive.com/forum/viewtopic.php?f=61&t=33250&start=${page}"; (( page = page + 25 )); done
  11.  
  12.  
  13.  
Add Comment
Please, Sign In to add comment