Advertisement
Guest User

Untitled

a guest
Jan 23rd, 2020
141
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 4.45 KB | None | 0 0
  1. 2020-01-23T09:18:26.578Z ACTOR: Creating Docker container.
  2. 2020-01-23T09:18:27.363Z ACTOR: Starting Docker container.
  3. 2020-01-23T09:18:29.325Z
  4. 2020-01-23T09:18:29.336Z > actor-puppeteer-scraper@1.0.0 start /home/myuser
  5. 2020-01-23T09:18:29.338Z > node main.js
  6. 2020-01-23T09:18:29.339Z
  7. 2020-01-23T09:18:32.209Z INFO: System info {"apifyVersion":"0.17.0","apifyClientVersion":"0.5.26","osType":"Linux","nodeVersion":"v10.17.0"}
  8. 2020-01-23T09:18:32.212Z WARNING: You are using an outdated version (0.17.0) of Apify SDK. We recommend you to update to the latest version (0.18.1).
  9. 2020-01-23T09:18:32.213Z Read more about Apify SDK versioning at: https://help.apify.com/en/articles/3184510-updates-and-versioning-of-apify-sdk
  10. 2020-01-23T09:18:32.363Z DEBUG: RequestList: Loading previous state from key value store using the persistStateKey.
  11. 2020-01-23T09:18:32.365Z DEBUG: RequestList: Loading sources from key value store using the persistSourcesKey.
  12. 2020-01-23T09:18:32.367Z INFO: Configuring Puppeteer Scraper.
  13. 2020-01-23T09:18:33.287Z INFO: Configuration completed. Starting the scrape.
  14. 2020-01-23T09:18:33.335Z DEBUG: AutoscaledPool: scaling up {"oldConcurrency":1,"newConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":null},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":null}}}
  15. 2020-01-23T09:18:33.339Z INFO: AutoscaledPool state {"currentConcurrency":0,"desiredConcurrency":2,"systemStatus":{"isSystemIdle":true,"memInfo":{"isOverloaded":false,"limitRatio":0.2,"actualRatio":null},"eventLoopInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"cpuInfo":{"isOverloaded":false,"limitRatio":0.4,"actualRatio":null},"clientInfo":{"isOverloaded":false,"limitRatio":0.3,"actualRatio":null}}}
  16. 2020-01-23T09:18:33.349Z INFO: Live view web server started {"publicUrl":"https://3dzkt24ok9n9.runs.apify.net"}
  17. 2020-01-23T09:18:33.350Z DEBUG: PuppeteerPool: Launching new browser {"id":0}
  18. 2020-01-23T09:18:33.453Z INFO: Launching Puppeteer {"ignoreHTTPSErrors":true,"defaultViewport":{"width":1920,"height":1080},"devtools":false,"useChrome":true,"stealth":true,"args":["--disable-web-security","--disk-cache-dir=/tmp/puppeteer_disk_cache-7cDZ1k","--no-sandbox","--user-agent=Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.70 Safari/537.36"],"timeout":15000,"headless":true,"executablePath":"/usr/bin/google-chrome","proxyUrl":"http://groups-RESIDENTIAL+SHADER:<redacted>@172.31.63.78:8011/"}
  19. 2020-01-23T09:18:34.118Z ERROR: BasicCrawler: handleRequestFunction failed, reclaiming failed request back to the list or queue {"url":"https://www.jomashop.com/victorinox-watch-241869.html","retryCount":1}
  20. 2020-01-23T09:18:34.119Z Error: net::ERR_SSL_PROTOCOL_ERROR at https://www.jomashop.com/victorinox-watch-241869.html
  21. 2020-01-23T09:18:34.124Z at navigate (/home/myuser/node_modules/puppeteer/lib/FrameManager.js:120:37)
  22. 2020-01-23T09:18:34.126Z at process._tickCallback (internal/process/next_tick.js:68:7)
  23. 2020-01-23T09:18:34.127Z -- ASYNC --
  24. 2020-01-23T09:18:34.128Z at Frame.<anonymous> (/home/myuser/node_modules/puppeteer/lib/helper.js:111:15)
  25. 2020-01-23T09:18:34.129Z at Page.goto (/home/myuser/node_modules/puppeteer/lib/Page.js:675:49)
  26. 2020-01-23T09:18:34.131Z at Page.<anonymous> (/home/myuser/node_modules/puppeteer/lib/helper.js:112:23)
  27. 2020-01-23T09:18:34.133Z at Object.gotoExtended (/home/myuser/node_modules/apify/build/puppeteer_utils.js:473:15)
  28. 2020-01-23T09:18:34.140Z at CrawlerSetup._gotoFunction (/home/myuser/src/crawler_setup.js:214:26)
  29. 2020-01-23T09:18:34.145Z at process._tickCallback (internal/process/next_tick.js:68:7)
  30. 2020-01-23T09:18:34.293Z ERROR: Request https://www.jomashop.com/victorinox-watch-241869.html failed and will not be retried anymore. Marking as failed.
  31. 2020-01-23T09:18:34.294Z Last Error Message: Error: net::ERR_SSL_PROTOCOL_ERROR at https://www.jomashop.com/victorinox-watch-241869.html
  32. 2020-01-23T09:18:34.407Z INFO: BasicCrawler: All the requests from request list and/or request queue have been processed, the crawler will shut down.
  33. 2020-01-23T09:18:34.412Z INFO: Crawler final request statistics: {"avgDurationMillis":null,"perMinute":0,"finished":0,"failed":0,"retryHistogram":[]}
  34. 2020-01-23T09:18:34.413Z INFO: Puppeteer Scraper finished.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement