Advertisement
dHeinemann

wls_experimental.pl

Mar 18th, 2011
53
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Perl 0.91 KB | None | 0 0
  1. #!/usr/bin/perl
  2. #Experimental version of wls.pl (http://pastebin.com/jdeMVw9u) for grabbing both HTML *and* images (and other stuff too).  It should work, except that it will spider across multiple Spaces and end up downloading everything.  If you know how to fix this, go ahead.
  3.  
  4. die("Usage: wls_experimental.pl \"<URL(s)>\" [wait]\n") unless ($ARGV[0]);
  5.  
  6. my $waitTime = 1;
  7. $waitTime = $ARGV[1] if ($ARGV[1]);
  8.  
  9. system("wget --mirror --page-requisites --continue --convert-links --user-agent=\"\" -e robots=off --span-hosts --exclude-domains=api.live.net,login.live.com --ignore-length --wait $waitTime $ARGV[0]");
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement