Advertisement
Guest User

Untitled

a guest
Feb 6th, 2016
62
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.26 KB | None | 0 0
  1. import requests
  2.  
  3. class Crawler():
  4. def __init__(self, url):
  5. self.url = url
  6.  
  7. def web_crawler(self):
  8. requests.get(self.url)
  9. return requests.text
  10.  
  11. for url in urls:
  12. crawler = Crawler(url)
  13. results = crawler.web_crawler()
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement