Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2020-01-23T09:18:26.578Z ACTOR: Creating Docker container.
- 2020-01-23T09:18:27.363Z ACTOR: Starting Docker container.
- 2020-01-23T09:18:29.325Z
- 2020-01-23T09:18:29.336Z > actor-puppeteer-scraper@1.0.0 start /home/myuser
- 2020-01-23T09:18:29.338Z > node main.js
- 2020-01-23T09:18:29.339Z
- 2020-01-23T09:18:32.209Z INFO: System info {"apifyVersion":"0.17.0","apifyClientVersion":"0.5.26","osType":"Linux","nodeVersion":"v10.17.0"}
- 2020-01-23T09:18:32.212Z WARNING: You are using an outdated version (0.17.0) of Apify SDK. We recommend you to update to the latest version (0.18.1).
- 2020-01-23T09:18:32.213Z Read more about Apify SDK versioning at: https://help.apify.com/en/articles/3184510-updates-and-versioning-of-apify-sdk
- 2020-01-23T09:18:32.363Z DEBUG: RequestList: Loading previous state from key value store using the persistStateKey.
- 2020-01-23T09:18:32.365Z DEBUG: RequestList: Loading sources from key value store using the persistSourcesKey.
- 2020-01-23T09:18:32.367Z INFO: Configuring Puppeteer Scraper.
- 2020-01-23T09:18:33.287Z INFO: Configuration completed. Starting the scrape.
- 2020-01-23T09:18:33.335Z DEBUG: AutoscaledPool: scaling up {"oldConcurrency":1,"newConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":null},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":null}}}
- 2020-01-23T09:18:33.339Z INFO: AutoscaledPool state {"currentConcurrency":0,"desiredConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":null},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":null}}}
- 2020-01-23T09:18:33.349Z INFO: Live view web server started {"publicUrl":"https://3dzkt24ok9n9.runs.apify.net"}
- 2020-01-23T09:18:33.350Z DEBUG: PuppeteerPool: Launching new browser {"id":0}
- 2020-01-23T09:18:33.453Z INFO: Launching Puppeteer {"ignoreHTTPSErrors":true,"defaultViewport":{"width":1920,"height":1080},"devtools":false,"useChrome":true,"stealth":true,"args":["--disable-web-security","--disk-cache-dir=/tmp/puppeteer_disk_cache-7cDZ1k","--no-sandbox","--user-agent=Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.70 Safari/537.36"],"timeout":15000,"headless":true,"executablePath":"/usr/bin/google-chrome","proxyUrl":"http://groups-RESIDENTIAL+SHADER:<redacted>@172.31.63.78:8011/"}
- 2020-01-23T09:18:34.118Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.jomashop.com/victorinox-watch-241869.html","retryCount":1}
- 2020-01-23T09:18:34.119Z Error: net::ERR_SSL_PROTOCOL_ERROR at https://www.jomashop.com/victorinox-watch-241869.html
- 2020-01-23T09:18:34.124Z at navigate (/home/myuser/node_modules/puppeteer/lib/FrameManager.js:120:37)
- 2020-01-23T09:18:34.126Z at process._tickCallback (internal/process/next_tick.js:68:7)
- 2020-01-23T09:18:34.127Z -- ASYNC --
- 2020-01-23T09:18:34.128Z at Frame.<anonymous> (/home/myuser/node_modules/puppeteer/lib/helper.js:111:15)
- 2020-01-23T09:18:34.129Z at Page.goto (/home/myuser/node_modules/puppeteer/lib/Page.js:675:49)
- 2020-01-23T09:18:34.131Z at Page.<anonymous> (/home/myuser/node_modules/puppeteer/lib/helper.js:112:23)
- 2020-01-23T09:18:34.133Z at Object.gotoExtended (/home/myuser/node_modules/apify/build/puppeteer_utils.js:473:15)
- 2020-01-23T09:18:34.140Z at CrawlerSetup._gotoFunction (/home/myuser/src/crawler_setup.js:214:26)
- 2020-01-23T09:18:34.145Z at process._tickCallback (internal/process/next_tick.js:68:7)
- 2020-01-23T09:18:34.293Z ERROR: Request https://www.jomashop.com/victorinox-watch-241869.html failed and will not be retried anymore. Marking as failed.
- 2020-01-23T09:18:34.294Z Last Error Message: Error: net::ERR_SSL_PROTOCOL_ERROR at https://www.jomashop.com/victorinox-watch-241869.html
- 2020-01-23T09:18:34.407Z INFO: BasicCrawler: All the requests from request list and/or request queue have been processed, the crawler will shut down.
- 2020-01-23T09:18:34.412Z INFO: Crawler final request statistics: {"avgDurationMillis":null,"perMinute":0,"finished":0,"failed":0,"retryHistogram":[]}
- 2020-01-23T09:18:34.413Z INFO: Puppeteer Scraper finished.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement