Advertisement
Guest User

Untitled

a guest
Apr 27th, 2014
68
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.60 KB | None | 0 0
  1. $ crawl -v --max_depth=2 --whitelist="^.*sourceforge\.net.*$" http://sourceforge.net/projects/xine/files/xine-lib/
  2. Crawling http://sourceforge.net/projects/xine/files/xine-lib/
  3. Traceback (most recent call last):
  4. File "/usr/bin/crawl", line 9, in <module>
  5. load_entry_point('spyda==0.0.3.dev', 'console_scripts', 'crawl')()
  6. File "/usr/lib/python2.7/site-packages/spyda/crawler.py", line 277, in main
  7. result = crawl(url, **opts.__dict__)
  8. File "/usr/lib/python2.7/site-packages/spyda/crawler.py", line 114, in crawl
  9. whitelist.extend(allowed_urls)
  10. TypeError: 'NoneType' object is not iterable
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement