$ crawl -v --max_depth=2 --whitelist="^.*sourceforge\.net.*$" http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/
Crawling http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/
 200 OK text/html; charset=utf-8 34604 77 http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/
  (F): http://sourceforge.net/
  (F): http://sourceforge.net/directory/
  (F): http://sourceforge.net/directory/enterprise
  (F): http://sourceforge.net/blog/
  (F): http://sourceforge.net/support
  (F): http://sourceforge.net/jobs?source=header
  (F): https://sourceforge.net/account/login.php
  (F): https://sourceforge.net/user/registration
  (F): http://goparallel.sourceforge.net/
  (F): http://ibmsmarteritservices.sourceforge.net/
  (F): http://library.slashdotmedia.com/?source=sfnet_header
  (S): https://sourceforge.net/user/registration
  (S): http://sourceforge.net/
  (F): http://sourceforge.net/directory
  (F): http://sourceforge.net/directory/audio-video/
  (F): http://sourceforge.net/directory/audio-video/video/
  (F): http://sourceforge.net/directory/audio-video/video/display/
  (F): http://sourceforge.net/projects/xine/
  (S): http://sourceforge.net/projects/xine/
  (F): http://sourceforge.net/users/dgp85
  (F): http://sourceforge.net/users/dsalt
  (F): http://sourceforge.net/users/f1rmb
  (F): http://sourceforge.net/users/miguelfreitas
  (F): http://sourceforge.net/p/xine/_members/
  (F): http://sourceforge.net/projects/xine/?source=navbar
  (F): http://sourceforge.net/projects/xine/files/?source=navbar
  (F): http://sourceforge.net/projects/xine/reviews?source=navbar
  (F): http://sourceforge.net/projects/xine/support?source=navbar
  (F): http://sourceforge.net/p/xine/wiki/?source=navbar
  (F): http://sourceforge.net/p/xine/mailman/?source=navbar
  (F): http://sourceforge.net/p/xine/_list/hg?source=navbar
  (F): http://sourceforge.net/p/xine/gxine/?source=navbar
  (F): http://sourceforge.net/p/xine/xine-lib/?source=navbar
  (F): http://sourceforge.net/p/xine/xine-lib-1.2/?source=navbar
  (F): http://sourceforge.net/p/xine/xine-plugin/?source=navbar
  (F): http://sourceforge.net/p/xine/xine-project-www/?source=navbar
  (F): http://sourceforge.net/p/xine/xine-ui/?source=navbar
  (F): http://sourceforge.net/p/xine/cvs/?source=navbar
  (F): https://sourceforge.net/p/forge/documentation/Release%20Files%20for%20Download
  (F): http://sourceforge.net/projects/xine/files/latest/download?source=files
  (F): http://sourceforge.net/api/file/index/project-id/9655/mtime/desc/limit/20/rss
  (F): http://sourceforge.net/projects/xine/files/
  (F): http://sourceforge.net/projects/xine/files/xine-lib/
  (S): http://sourceforge.net/projects/xine/files/xine-lib/
  (F): http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/release.txt/download
  (F): http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/release.txt/stats/timeline
  (F): http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/compat.c/download
  (F): http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/compat.c/stats/timeline
  (F): http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/xine-lib-1.1.18.tar.xz/download
  (F): http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/xine-lib-1.1.18.tar.xz/stats/timeline
  (F): http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/xine-lib-1.1.18.tar.bz2/download
  (F): http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/xine-lib-1.1.18.tar.bz2/stats/timeline
  (F): http://www.indeed.com/
  (S): http://www.indeed.com/
  (F): http://www.dice.com/?CMPID=AF_SF_UP_JS_AV_OG_BN_&utm_campaign=Advocacy_Ongoing&utm_content=&utm_medium=Affiliate&utm_source=SourceForge
  (F): http://sourceforge.net/jobs?source=widget
  (S): http://sourceforge.net/jobs?source=widget
  (F): http://sourceforge.net/about
  (F): http://sourceforge.net/blog/category/sitestatus/
  (F): http://twitter.com/sfnet_ops
  (F): http://sourceforge.net/create/
  (S): http://sourceforge.net/directory/
  (F): http://sourceforge.net/top
  (S): http://sourceforge.net/blog/
  (F): http://twitter.com/sourceforge
  (F): http://sourceforge.net/jobs?source=footer
  (F): http://library.slashdotmedia.com/?source=sfnet_footer
  (F): http://p.sf.net/sourceforge/docs
  (S): http://sourceforge.net/support
  (F): http://p.sf.net/sourceforge/irc
  (F): http://www.diceholdingsinc.com/phoenix.zhtml?c=211152&p=irol-landing
  (F): http://slashdotmedia.com/terms-of-use/
  (F): http://slashdotmedia.com/privacy-statement/
  (F): http://slashdotmedia.com/opt-out-choices/
  (F): http://slashdotmedia.com/
  (F): http://sourceforge.jp/
  (F): http://apmsolutions.sourceforge.net/
 200 OK text/html; charset=utf-8 35635 82 http://sourceforge.net/
  (S): http://sourceforge.net/
  (S): http://sourceforge.net/directory/
  (S): http://sourceforge.net/directory/enterprise
  (S): http://sourceforge.net/blog/
  (S): http://sourceforge.net/support
  (S): http://sourceforge.net/jobs?source=header
  (S): https://sourceforge.net/account/login.php
  (S): https://sourceforge.net/user/registration
  (S): http://goparallel.sourceforge.net/
  (S): http://ibmsmarteritservices.sourceforge.net/
  (S): http://library.slashdotmedia.com/?source=sfnet_header
  (S): https://sourceforge.net/user/registration
  (S): http://sourceforge.net/directory
  (F): http://sourceforge.net/create
  (F): http://sourceforge.net/publish
  (S): http://sourceforge.net/top
  (F): http://sourceforge.net/directory/audio-video
  (F): http://sourceforge.net/directory/business-enterprise
  (F): http://sourceforge.net/directory/communications
  (F): http://sourceforge.net/directory/development
  (F): http://sourceforge.net/directory/home-education
  (F): http://sourceforge.net/directory/games
  (F): http://sourceforge.net/directory/graphics
  (F): http://sourceforge.net/directory/science-engineering
  (F): http://sourceforge.net/directory/security-utilities
  (F): http://sourceforge.net/directory/system-administration
  (S): http://twitter.com/sourceforge
  (F): http://t.co/hp7jKuF92e
  (F): http://t.co/Z01lRIevpt
  (F): http://t.co/g6uCT3Dm5r
  (F): http://t.co/DYAAr9j49V
  (F): http://sourceforge.net/projects/win32diskimager/?position=1&source=frontpage
  (F): http://sourceforge.net/projects/win32diskimager/files/latest/download?position=1&source=frontpage
  (F): http://sourceforge.net/projects/unimediaserver/?position=1&source=frontpage
  (F): http://sourceforge.net/projects/unimediaserver/files/latest/download?position=1&source=frontpage
  (F): http://sourceforge.net/projects/openofficeorg.mirror/?position=1&source=frontpage
  (F): http://sourceforge.net/projects/openofficeorg.mirror/files/latest/download?position=1&source=frontpage
  (F): http://sourceforge.net/projects/filezilla/?position=1&source=frontpage
  (F): http://sourceforge.net/projects/filezilla/files/latest/download?position=1&source=frontpage
  (F): http://sourceforge.net/projects/dfendreloaded/?position=1&source=frontpage
  (F): http://sourceforge.net/projects/dfendreloaded/files/latest/download?position=1&source=frontpage
  (F): http://sourceforge.net/projects/digicamcontrol/?position=2&source=frontpage
  (F): http://sourceforge.net/projects/digicamcontrol/files/latest/download?position=2&source=frontpage
  (F): http://sourceforge.net/projects/devkitpro/?position=3&source=frontpage
  (F): http://sourceforge.net/projects/devkitpro/files/latest/download?position=3&source=frontpage
  (F): http://sourceforge.net/projects/areca/?position=4&source=frontpage
  (F): http://sourceforge.net/projects/areca/files/latest/download?position=4&source=frontpage
  (F): http://sourceforge.net/projects/grisbi/?position=5&source=frontpage
  (F): http://sourceforge.net/projects/grisbi/files/latest/download?position=5&source=frontpage
  (F): http://sourceforge.net/projects/miniserver/?position=6&source=frontpage
  (F): http://sourceforge.net/projects/miniserver/files/latest/download?position=6&source=frontpage
  (F): http://sourceforge.net/projects/calibre/?position=7&source=frontpage
  (F): http://sourceforge.net/projects/calibre/files/latest/download?position=7&source=frontpage
  (F): http://sourceforge.net/projects/freeghost/?position=8&source=frontpage
  (F): http://sourceforge.net/projects/freeghost/files/latest/download?position=8&source=frontpage
  (F): http://sourceforge.net/projects/maxima/?position=9&source=frontpage
  (F): http://sourceforge.net/projects/maxima/files/latest/download?position=9&source=frontpage
  (S): http://sourceforge.net/blog/
  (F): http://sourceforge.net/blog/sourceforge-response-to-heartbleed/?utm_campaign=sourceforge-response-to-heartbleed&utm_medium=rss&utm_source=rss
  (S): http://sourceforge.net/blog/sourceforge-response-to-heartbleed/?utm_campaign=sourceforge-response-to-heartbleed&utm_medium=rss&utm_source=rss
  (F): http://sourceforge.net/blog/projects-of-the-week-april-7-2014/?utm_campaign=projects-of-the-week-april-7-2014&utm_medium=rss&utm_source=rss
  (S): http://sourceforge.net/blog/projects-of-the-week-april-7-2014/?utm_campaign=projects-of-the-week-april-7-2014&utm_medium=rss&utm_source=rss
  (S): http://sourceforge.net/about
  (S): http://sourceforge.net/blog/category/sitestatus/
  (S): http://twitter.com/sfnet_ops
  (S): http://sourceforge.net/create/
  (S): http://sourceforge.net/directory/
  (S): http://sourceforge.net/top
  (S): http://sourceforge.net/blog/
  (S): http://twitter.com/sourceforge
  (S): http://sourceforge.net/jobs?source=footer
  (S): http://library.slashdotmedia.com/?source=sfnet_footer
  (S): http://p.sf.net/sourceforge/docs
  (S): http://sourceforge.net/support
  (S): http://p.sf.net/sourceforge/irc
  (S): http://www.diceholdingsinc.com/phoenix.zhtml?c=211152&p=irol-landing
  (S): http://slashdotmedia.com/terms-of-use/
  (S): http://slashdotmedia.com/privacy-statement/
  (S): http://slashdotmedia.com/opt-out-choices/
  (S): http://slashdotmedia.com/
  (S): http://sourceforge.jp/
  (S): http://goparallel.sourceforge.net/
URL(s):
http://sourceforge.net/
http://sourceforge.net/directory/
http://sourceforge.net/directory/enterprise
http://sourceforge.net/blog/
http://sourceforge.net/support
http://sourceforge.net/jobs?source=header
https://sourceforge.net/account/login.php
https://sourceforge.net/user/registration
http://goparallel.sourceforge.net/
http://ibmsmarteritservices.sourceforge.net/
http://library.slashdotmedia.com/?source=sfnet_header
http://sourceforge.net/directory
http://sourceforge.net/directory/audio-video/
http://sourceforge.net/directory/audio-video/video/
http://sourceforge.net/directory/audio-video/video/display/
http://sourceforge.net/projects/xine/
http://sourceforge.net/users/dgp85
http://sourceforge.net/users/dsalt
http://sourceforge.net/users/f1rmb
http://sourceforge.net/users/miguelfreitas
http://sourceforge.net/p/xine/_members/
http://sourceforge.net/projects/xine/?source=navbar
http://sourceforge.net/projects/xine/files/?source=navbar
http://sourceforge.net/projects/xine/reviews?source=navbar
http://sourceforge.net/projects/xine/support?source=navbar
http://sourceforge.net/p/xine/wiki/?source=navbar
http://sourceforge.net/p/xine/mailman/?source=navbar
http://sourceforge.net/p/xine/_list/hg?source=navbar
http://sourceforge.net/p/xine/gxine/?source=navbar
http://sourceforge.net/p/xine/xine-lib/?source=navbar
http://sourceforge.net/p/xine/xine-lib-1.2/?source=navbar
http://sourceforge.net/p/xine/xine-plugin/?source=navbar
http://sourceforge.net/p/xine/xine-project-www/?source=navbar
http://sourceforge.net/p/xine/xine-ui/?source=navbar
http://sourceforge.net/p/xine/cvs/?source=navbar
https://sourceforge.net/p/forge/documentation/Release%20Files%20for%20Download
http://sourceforge.net/projects/xine/files/latest/download?source=files
http://sourceforge.net/api/file/index/project-id/9655/mtime/desc/limit/20/rss
http://sourceforge.net/projects/xine/files/
http://sourceforge.net/projects/xine/files/xine-lib/
http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/release.txt/download
http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/release.txt/stats/timeline
http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/compat.c/download
http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/compat.c/stats/timeline
http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/xine-lib-1.1.18.tar.xz/download
http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/xine-lib-1.1.18.tar.xz/stats/timeline
http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/xine-lib-1.1.18.tar.bz2/download
http://sourceforge.net/projects/xine/files/xine-lib/1.1.18/xine-lib-1.1.18.tar.bz2/stats/timeline
http://www.indeed.com/
http://www.dice.com/?CMPID=AF_SF_UP_JS_AV_OG_BN_&utm_campaign=Advocacy_Ongoing&utm_content=&utm_medium=Affiliate&utm_source=SourceForge
http://sourceforge.net/jobs?source=widget
http://sourceforge.net/about
http://sourceforge.net/blog/category/sitestatus/
http://twitter.com/sfnet_ops
http://sourceforge.net/create/
http://sourceforge.net/top
http://twitter.com/sourceforge
http://sourceforge.net/jobs?source=footer
http://library.slashdotmedia.com/?source=sfnet_footer
http://p.sf.net/sourceforge/docs
http://p.sf.net/sourceforge/irc
http://www.diceholdingsinc.com/phoenix.zhtml?c=211152&p=irol-landing
http://slashdotmedia.com/terms-of-use/
http://slashdotmedia.com/privacy-statement/
http://slashdotmedia.com/opt-out-choices/
http://slashdotmedia.com/
http://sourceforge.jp/
http://apmsolutions.sourceforge.net/
http://sourceforge.net/create
http://sourceforge.net/publish
http://sourceforge.net/directory/audio-video
http://sourceforge.net/directory/business-enterprise
http://sourceforge.net/directory/communications
http://sourceforge.net/directory/development
http://sourceforge.net/directory/home-education
http://sourceforge.net/directory/games
http://sourceforge.net/directory/graphics
http://sourceforge.net/directory/science-engineering
http://sourceforge.net/directory/security-utilities
http://sourceforge.net/directory/system-administration
http://t.co/hp7jKuF92e
http://t.co/Z01lRIevpt
http://t.co/g6uCT3Dm5r
http://t.co/DYAAr9j49V
http://sourceforge.net/projects/win32diskimager/?position=1&source=frontpage
http://sourceforge.net/projects/win32diskimager/files/latest/download?position=1&source=frontpage
http://sourceforge.net/projects/unimediaserver/?position=1&source=frontpage
http://sourceforge.net/projects/unimediaserver/files/latest/download?position=1&source=frontpage
http://sourceforge.net/projects/openofficeorg.mirror/?position=1&source=frontpage
http://sourceforge.net/projects/openofficeorg.mirror/files/latest/download?position=1&source=frontpage
http://sourceforge.net/projects/filezilla/?position=1&source=frontpage
http://sourceforge.net/projects/filezilla/files/latest/download?position=1&source=frontpage
http://sourceforge.net/projects/dfendreloaded/?position=1&source=frontpage
http://sourceforge.net/projects/dfendreloaded/files/latest/download?position=1&source=frontpage
http://sourceforge.net/projects/digicamcontrol/?position=2&source=frontpage
http://sourceforge.net/projects/digicamcontrol/files/latest/download?position=2&source=frontpage
http://sourceforge.net/projects/devkitpro/?position=3&source=frontpage
http://sourceforge.net/projects/devkitpro/files/latest/download?position=3&source=frontpage
http://sourceforge.net/projects/areca/?position=4&source=frontpage
http://sourceforge.net/projects/areca/files/latest/download?position=4&source=frontpage
http://sourceforge.net/projects/grisbi/?position=5&source=frontpage
http://sourceforge.net/projects/grisbi/files/latest/download?position=5&source=frontpage
http://sourceforge.net/projects/miniserver/?position=6&source=frontpage
http://sourceforge.net/projects/miniserver/files/latest/download?position=6&source=frontpage
http://sourceforge.net/projects/calibre/?position=7&source=frontpage
http://sourceforge.net/projects/calibre/files/latest/download?position=7&source=frontpage
http://sourceforge.net/projects/freeghost/?position=8&source=frontpage
http://sourceforge.net/projects/freeghost/files/latest/download?position=8&source=frontpage
http://sourceforge.net/projects/maxima/?position=9&source=frontpage
http://sourceforge.net/projects/maxima/files/latest/download?position=9&source=frontpage
http://sourceforge.net/blog/sourceforge-response-to-heartbleed/?utm_campaign=sourceforge-response-to-heartbleed&utm_medium=rss&utm_source=rss
http://sourceforge.net/blog/projects-of-the-week-april-7-2014/?utm_campaign=projects-of-the-week-april-7-2014&utm_medium=rss&utm_source=rss
112 urls in 3.41s (32/s) CPU: 0.42s