Guest User

Untitled

a guest
Mar 27th, 2018
153
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 2.24 KB | None | 0 0
  1. 1. 2018-03-27 00:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST
  2. https://www.bank.org/signin-page.html> (referer:
  3. https://www.bank.org/signin-page.html)
  4. 2. 2018-03-27 00:56:56 [LOG] INFO: LOGIN ATTEMPT SUCCESSFUL
  5. 3. 2018-03-27 00:56:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET
  6. https://www.bankonline.org/robots.txt> (referer: None)
  7. 4. 2018-03-27 00:56:56 [scrapy.downloadermiddlewares.redirect] DEBUG:
  8. Redirecting (302) to <GET https://www.bankonline.org/tob/live/usp-
  9. core/app/logout?reason=logout> from <GET
  10. https://www.bankonline.org/tob/live/usp-core/app/home>
  11. 5. 2018-03-27 00:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET
  12. https://www.bankonline.org/tob/live/usp-core/app/logout?
  13. reason=logout> (referer: https://www.bank.org/signin-page.html)
  14. 6. 2018-03-27 00:56:56 [LOG] INFO: VISITED
  15. https://www.bankonline.org/tob/live/usp-core/app/logout?
  16. reason=logout
  17. 7. 2018-03-27 00:56:57 [scrapy.core.engine] INFO: Closing spider
  18. (finished)
  19.  
  20. import scrapy
  21. import logging
  22.  
  23. logger = logging.getLogger('LOG')
  24. USERNAME = 'user'
  25. PASSWORD = 'pass'
  26.  
  27. class Budget_Bank(scrapy.Spider):
  28. name = "Budget_Bank"
  29. login_url = 'https://www.bank.org/signin-page.html'
  30. start_urls = ['https://www.bank.org/signin-page.html']
  31.  
  32. def parse(self, response):
  33. yield scrapy.FormRequest(url=self.login_url,
  34. formdata={'username': USERNAME,
  35. 'password': PASSWORD},
  36. callback=self.login_test)
  37.  
  38.  
  39. def login_test(self, response):
  40. if 'errors' in response.text:
  41. logger.warning("LOGIN ATTEMPT FAILED")
  42. return
  43. else:
  44. logger.info("LOGIN ATTEMPT SUCCESSFUL")
  45. yield scrapy.Request('https://www.bankonline.org'
  46. '/tob/live/usp-core/app/home',
  47. callback=self.parse_number)
  48.  
  49.  
  50. def parse_number(self, response):
  51. logger.info("VISITED %s", response.url)
  52. for number in response.css('div._1qtcLoK1d4PZmeghcgyE2K'):
  53. yield {
  54. 'num': number.css('span.formattedMoney_balanceBZozG-'
  55. ...::text').extract_first(),
  56. }
Add Comment
Please, Sign In to add comment