Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2017-04-24 15:16:14 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.facebook.com/>
- {'result': [['"58fdfa9e88d77200018806aa"']], 'config': {'action': 'insert', 'prefix': 'database.crawler', 'database': 'Wj5uRX2fCT4EP5C7mTqe3RwJgT3ur15q', 'collection': 'facebookcom', 'query': '{"ad_id": null}'}}
- 2017-04-24 15:16:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.facebook.com/>
- {'result': [['"58fdfa9e88d77200018806ac"']], 'config': {'action': 'insert', 'prefix': 'database.crawler', 'database': 'Wj5uRX2fCT4EP5C7mTqe3RwJgT3ur15q', 'collection': 'facebookcom', 'query': '{"ad_id": null}'}}
- 2017-04-24 15:16:14 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/window {"name": "CDwindow-ff80e5f4-291a-4352-8ecf-977262a5f0e4", "sessionId": "088ba791f3babbe3f5c174033d18d959"}
- 2017-04-24 15:16:14 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:17 [selenium.webdriver.remote.remote_connection] DEBUG: GET http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/url {"sessionId": "088ba791f3babbe3f5c174033d18d959"}
- 2017-04-24 15:16:17 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:17 [selenium.webdriver.remote.remote_connection] DEBUG: GET http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/source {"sessionId": "088ba791f3babbe3f5c174033d18d959"}
- 2017-04-24 15:16:18 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.facebook.com/> (referer: https://www.facebook.com/)
- 2017-04-24 15:16:18 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/elements {"value": "//div[starts-with(@id, \"topnews_main_stream_\")]", "sessionId": "088ba791f3babbe3f5c174033d18d959", "using": "xpath"}
- 2017-04-24 15:16:18 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:18 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/element/0.16928583880129344-1/elements {"value": "//div[starts-with(@id, \"hyperfeed_story_id_\")]", "sessionId": "088ba791f3babbe3f5c174033d18d959", "using": "xpath", "id": "0.16928583880129344-1"}
- 2017-04-24 15:16:18 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:18 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/element/0.16928583880129344-2/elements {"value": "Sponsorowane", "sessionId": "088ba791f3babbe3f5c174033d18d959", "using": "link text", "id": "0.16928583880129344-2"}
- 2017-04-24 15:16:18 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:18 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/element/0.16928583880129344-3/elements {"value": "Sponsorowane", "sessionId": "088ba791f3babbe3f5c174033d18d959", "using": "link text", "id": "0.16928583880129344-3"}
- 2017-04-24 15:16:18 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.facebook.com/>
- {'result': [['"58fdfaa288d77200018806ae"']], 'config': {'action': 'insert', 'prefix': 'database.crawler', 'database': 'Wj5uRX2fCT4EP5C7mTqe3RwJgT3ur15q', 'collection': 'facebookcom', 'query': '{"ad_id": null}'}}
- 2017-04-24 15:16:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.facebook.com/>
- {'result': [['"58fdfaa288d77200018806b0"']], 'config': {'action': 'insert', 'prefix': 'database.crawler', 'database': 'Wj5uRX2fCT4EP5C7mTqe3RwJgT3ur15q', 'collection': 'facebookcom', 'query': '{"ad_id": null}'}}
- 2017-04-24 15:16:18 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/window {"name": "CDwindow-ff80e5f4-291a-4352-8ecf-977262a5f0e4", "sessionId": "088ba791f3babbe3f5c174033d18d959"}
- 2017-04-24 15:16:18 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: GET http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/url {"sessionId": "088ba791f3babbe3f5c174033d18d959"}
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: GET http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/source {"sessionId": "088ba791f3babbe3f5c174033d18d959"}
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.facebook.com/> (referer: https://www.facebook.com/)
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/elements {"value": "//div[starts-with(@id, \"topnews_main_stream_\")]", "sessionId": "088ba791f3babbe3f5c174033d18d959", "using": "xpath"}
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/element/0.16928583880129344-1/elements {"value": "//div[starts-with(@id, \"hyperfeed_story_id_\")]", "sessionId": "088ba791f3babbe3f5c174033d18d959", "using": "xpath", "id": "0.16928583880129344-1"}
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/element/0.16928583880129344-2/elements {"value": "Sponsorowane", "sessionId": "088ba791f3babbe3f5c174033d18d959", "using": "link text", "id": "0.16928583880129344-2"}
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/element/0.16928583880129344-3/elements {"value": "Sponsorowane", "sessionId": "088ba791f3babbe3f5c174033d18d959", "using": "link text", "id": "0.16928583880129344-3"}
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- 2017-04-24 15:16:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.facebook.com/>
- {'result': [['"58fdfaa488d77200018806b2"']], 'config': {'action': 'insert', 'prefix': 'database.crawler', 'database': 'Wj5uRX2fCT4EP5C7mTqe3RwJgT3ur15q', 'collection': 'facebookcom', 'query': '{"ad_id": null}'}}
- 2017-04-24 15:16:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.facebook.com/>
- {'result': [['"58fdfaa488d77200018806b4"']], 'config': {'action': 'insert', 'prefix': 'database.crawler', 'database': 'Wj5uRX2fCT4EP5C7mTqe3RwJgT3ur15q', 'collection': 'facebookcom', 'query': '{"ad_id": null}'}}
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: POST http://127.0.0.1:55039/session/088ba791f3babbe3f5c174033d18d959/window {"name": "CDwindow-ff80e5f4-291a-4352-8ecf-977262a5f0e4", "sessionId": "088ba791f3babbe3f5c174033d18d959"}
- 2017-04-24 15:16:20 [selenium.webdriver.remote.remote_connection] DEBUG: Finished Request
- ^C2017-04-24 15:16:22 [scrapy.crawler] INFO: Received SIG_SETMASK, shutting down gracefully. Send again to force
- 2017-04-24 15:16:22 [scrapy.core.engine] INFO: Closing spider (shutdown)
- ^C2017-04-24 15:16:22 [scrapy.crawler] INFO: Received SIG_SETMASK twice, forcing unclean shutdown
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement