Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 1. 2018-03-27 00:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST
- https://www.bank.org/signin-page.html> (referer:
- https://www.bank.org/signin-page.html)
- 2. 2018-03-27 00:56:56 [LOG] INFO: LOGIN ATTEMPT SUCCESSFUL
- 3. 2018-03-27 00:56:56 [scrapy.core.engine] DEBUG: Crawled (404) <GET
- https://www.bankonline.org/robots.txt> (referer: None)
- 4. 2018-03-27 00:56:56 [scrapy.downloadermiddlewares.redirect] DEBUG:
- Redirecting (302) to <GET https://www.bankonline.org/tob/live/usp-
- core/app/logout?reason=logout> from <GET
- https://www.bankonline.org/tob/live/usp-core/app/home>
- 5. 2018-03-27 00:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET
- https://www.bankonline.org/tob/live/usp-core/app/logout?
- reason=logout> (referer: https://www.bank.org/signin-page.html)
- 6. 2018-03-27 00:56:56 [LOG] INFO: VISITED
- https://www.bankonline.org/tob/live/usp-core/app/logout?
- reason=logout
- 7. 2018-03-27 00:56:57 [scrapy.core.engine] INFO: Closing spider
- (finished)
- import scrapy
- import logging
- logger = logging.getLogger('LOG')
- USERNAME = 'user'
- PASSWORD = 'pass'
- class Budget_Bank(scrapy.Spider):
- name = "Budget_Bank"
- login_url = 'https://www.bank.org/signin-page.html'
- start_urls = ['https://www.bank.org/signin-page.html']
- def parse(self, response):
- yield scrapy.FormRequest(url=self.login_url,
- formdata={'username': USERNAME,
- 'password': PASSWORD},
- callback=self.login_test)
- def login_test(self, response):
- if 'errors' in response.text:
- logger.warning("LOGIN ATTEMPT FAILED")
- return
- else:
- logger.info("LOGIN ATTEMPT SUCCESSFUL")
- yield scrapy.Request('https://www.bankonline.org'
- '/tob/live/usp-core/app/home',
- callback=self.parse_number)
- def parse_number(self, response):
- logger.info("VISITED %s", response.url)
- for number in response.css('div._1qtcLoK1d4PZmeghcgyE2K'):
- yield {
- 'num': number.css('span.formattedMoney_balanceBZozG-'
- ...::text').extract_first(),
- }
Add Comment
Please, Sign In to add comment