Feb 25 12:41:04 social-crawler-2 linkedin_crawler[4268]: > linkedin-profile-scraper@1.0.0 start /home/bino/app/social-crawler-js
Feb 25 12:41:04 social-crawler-2 linkedin_crawler[4268]: > node index.js
Feb 25 12:41:07 social-crawler-2 linkedin_crawler[4268]: Server setup: Setting up...
Feb 25 12:41:07 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:41:07.460Z (setup): Launching puppeteer in the background...
Feb 25 12:41:08 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:41:08.003Z (setup): Puppeteer launched!
Feb 25 12:41:08 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:41:08.109Z (setup): Blocking the following resources: image, stylesheet, media, font, texttrack, object, beacon, csp_report, imageset
Feb 25 12:41:08 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:41:08.114Z (setup): Setting session cookie using cookie: AQEDASXkC2EDtk_JAAABcHrU4RYAAAFwnuFlFlEAdKTV9CoDz4XCJVQrsiA9xMCU-fu1Dp7FYKSTVkQ785we7AKmMLKNcH0EMoY3c0HZnIJY5m4sqWTIvCufpPkYVIE9D_H2apEMpLOuTPaBNgE3HHQX
Feb 25 12:41:08 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:41:08.147Z (setup): Session cookie set!
Feb 25 12:41:08 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:41:08.147Z (setup): Browsing to LinkedIn.com in the background using a headless browser...
Feb 25 12:41:11 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:41:11.630Z (setup): Adding helper methods to page
Feb 25 12:41:12 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:41:12.122Z (setup): Checking if we are logged in successfully...
Feb 25 12:41:12 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:41:12.124Z (authentication): Check if we are still logged in...
Feb 25 12:41:12 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:41:12.129Z (authentication): All good. We are still logged in.
Feb 25 12:41:12 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:41:12.129Z (setup): Done!
Feb 25 12:41:12 social-crawler-2 linkedin_crawler[4268]: Server setup: All done. Listening on port 7575!
Feb 25 12:42:01 social-crawler-2 CRON[4405]: (bino) CMD (/usr/bin/flock -n /tmp/linkedin.lock /home/bino/app/.venv_py3/bin/python /home/bino/app/social-crawler/agent/linkedin.py /home/bino/app/social-crawler/phoenix.conf >> /home/bino/logs/linkedin-$(date '+%F').log 2>&1)
Feb 25 12:47:47 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:47:47.106Z (scraping-profile) (1582609667106): Navigating to LinkedIn profile: https://www.linkedin.com/company/pt-aj-sequis-financial
Feb 25 12:47:49 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:47:49.029Z (scraping-profile) (1582609667106): LinkedIn profile page loaded!
Feb 25 12:47:49 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:47:49.030Z (scraping-profile) (1582609667106): Parsing data...
Feb 25 12:47:49 social-crawler-2 linkedin_crawler[4268]: Processing Profile done
Feb 25 12:47:49 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:47:49.111Z (scraping-posts) (1582609669111): Navigating to LinkedIn profile: https://www.linkedin.com/company/pt-aj-sequis-financial
Feb 25 12:47:50 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:47:50.834Z (scraping-posts) (1582609669111): LinkedIn profile page loaded!
Feb 25 12:47:50 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:47:50.837Z (scraping-posts) (1582609669111): Getting all the LinkedIn profile data by scrolling the page to the bottom, so all the data gets loaded into the page...
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:47:56.394Z (scraping-posts) (1582609669111): Parsing data...
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:47:56.394Z (scraping-posts) (1582609669111): Expanding all sections by clicking their "See more" buttons
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]: (node:4296) UnhandledPromiseRejectionWarning: Error: Evaluation failed: TypeError: Cannot read property 'replace' of undefined
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at __puppeteer_evaluation_script__:32:37
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at Array.map (<anonymous>)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at __puppeteer_evaluation_script__:2:92
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at new Promise (<anonymous>)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at __puppeteer_evaluation_script__:1:8
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at ExecutionContext._evaluateInternal (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/ExecutionContext.js:122:13)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at <anonymous>
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at process._tickCallback (internal/process/next_tick.js:188:7)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:   -- ASYNC --
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at ExecutionContext.<anonymous> (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/helper.js:111:15)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at DOMWorld.evaluate (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/DOMWorld.js:112:20)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at <anonymous>
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at process._tickCallback (internal/process/next_tick.js:188:7)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:   -- ASYNC --
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at Frame.<anonymous> (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/helper.js:111:15)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at Page.evaluate (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/Page.js:833:43)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at Page.<anonymous> (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/helper.js:112:23)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at getLinkedinPost (/home/bino/app/social-crawler-js/scraper/linkedin.js:228:30)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at <anonymous>
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]:     at process._tickCallback (internal/process/next_tick.js:188:7)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]: (node:4296) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 1)
Feb 25 12:47:56 social-crawler-2 linkedin_crawler[4268]: (node:4296) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.
Feb 25 12:49:47 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:49:47.113Z (scraping-profile) (1582609787113): Navigating to LinkedIn profile: https://www.linkedin.com/company/pt-aj-sequis-financial
Feb 25 12:49:48 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:49:48.622Z (scraping-profile) (1582609787113): LinkedIn profile page loaded!
Feb 25 12:49:48 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:49:48.622Z (scraping-profile) (1582609787113): Parsing data...
Feb 25 12:49:48 social-crawler-2 linkedin_crawler[4268]: Processing Profile done
Feb 25 12:49:48 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:49:48.663Z (scraping-posts) (1582609788663): Navigating to LinkedIn profile: https://www.linkedin.com/company/pt-aj-sequis-financial
Feb 25 12:49:50 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:49:50.004Z (scraping-posts) (1582609788663): LinkedIn profile page loaded!
Feb 25 12:49:50 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:49:50.004Z (scraping-posts) (1582609788663): Getting all the LinkedIn profile data by scrolling the page to the bottom, so all the data gets loaded into the page...
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:49:56.082Z (scraping-posts) (1582609788663): Parsing data...
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:49:56.082Z (scraping-posts) (1582609788663): Expanding all sections by clicking their "See more" buttons
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]: (node:4296) UnhandledPromiseRejectionWarning: Error: Evaluation failed: TypeError: Cannot read property 'replace' of undefined
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at __puppeteer_evaluation_script__:32:37
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at Array.map (<anonymous>)
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at __puppeteer_evaluation_script__:2:92
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at new Promise (<anonymous>)
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at __puppeteer_evaluation_script__:1:8
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at ExecutionContext._evaluateInternal (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/ExecutionContext.js:122:13)
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at <anonymous>
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at process._tickCallback (internal/process/next_tick.js:188:7)
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:   -- ASYNC --
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at ExecutionContext.<anonymous> (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/helper.js:111:15)
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at DOMWorld.evaluate (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/DOMWorld.js:112:20)
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at <anonymous>
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at process._tickCallback (internal/process/next_tick.js:188:7)
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:   -- ASYNC --
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at Frame.<anonymous> (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/helper.js:111:15)
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at Page.evaluate (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/Page.js:833:43)
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at Page.<anonymous> (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/helper.js:112:23)
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at getLinkedinPost (/home/bino/app/social-crawler-js/scraper/linkedin.js:228:30)
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at <anonymous>
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]:     at process._tickCallback (internal/process/next_tick.js:188:7)
Feb 25 12:49:56 social-crawler-2 linkedin_crawler[4268]: (node:4296) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 2)
Feb 25 12:51:47 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:51:47.129Z (scraping-profile) (1582609907129): Navigating to LinkedIn profile: https://www.linkedin.com/company/pt-aj-sequis-financial
Feb 25 12:51:48 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:51:48.358Z (scraping-profile) (1582609907129): LinkedIn profile page loaded!
Feb 25 12:51:48 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:51:48.358Z (scraping-profile) (1582609907129): Parsing data...
Feb 25 12:51:48 social-crawler-2 linkedin_crawler[4268]: Processing Profile done
Feb 25 12:51:48 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:51:48.902Z (scraping-posts) (1582609908902): Navigating to LinkedIn profile: https://www.linkedin.com/company/pt-aj-sequis-financial
Feb 25 12:51:50 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:51:50.249Z (scraping-posts) (1582609908902): LinkedIn profile page loaded!
Feb 25 12:51:50 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:51:50.250Z (scraping-posts) (1582609908902): Getting all the LinkedIn profile data by scrolling the page to the bottom, so all the data gets loaded into the page...
Feb 25 12:51:52 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:51:52.272Z (scraping-posts) (1582609908902): Parsing data...
Feb 25 12:51:52 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:51:52.274Z (scraping-posts) (1582609908902): Expanding all sections by clicking their "See more" buttons
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]: (node:4296) UnhandledPromiseRejectionWarning: Error: Evaluation failed: TypeError: Cannot read property 'replace' of undefined
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at __puppeteer_evaluation_script__:32:37
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at Array.map (<anonymous>)
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at __puppeteer_evaluation_script__:2:92
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at new Promise (<anonymous>)
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at __puppeteer_evaluation_script__:1:8
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at ExecutionContext._evaluateInternal (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/ExecutionContext.js:122:13)
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at <anonymous>
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at process._tickCallback (internal/process/next_tick.js:188:7)
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:   -- ASYNC --
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at ExecutionContext.<anonymous> (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/helper.js:111:15)
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at DOMWorld.evaluate (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/DOMWorld.js:112:20)
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at <anonymous>
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at process._tickCallback (internal/process/next_tick.js:188:7)
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:   -- ASYNC --
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at Frame.<anonymous> (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/helper.js:111:15)
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at Page.evaluate (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/Page.js:833:43)
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at Page.<anonymous> (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/helper.js:112:23)
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at getLinkedinPost (/home/bino/app/social-crawler-js/scraper/linkedin.js:228:30)
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at <anonymous>
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]:     at process._tickCallback (internal/process/next_tick.js:188:7)
Feb 25 12:51:53 social-crawler-2 linkedin_crawler[4268]: (node:4296) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 3)
Feb 25 12:53:47 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:53:47.140Z (scraping-profile) (1582610027140): Navigating to LinkedIn profile: https://www.linkedin.com/company/pt-aj-sequis-financial
Feb 25 12:53:48 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:53:48.739Z (scraping-profile) (1582610027140): LinkedIn profile page loaded!
Feb 25 12:53:48 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:53:48.740Z (scraping-profile) (1582610027140): Parsing data...
Feb 25 12:53:48 social-crawler-2 linkedin_crawler[4268]: Processing Profile done
Feb 25 12:53:48 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:53:48.799Z (scraping-posts) (1582610028799): Navigating to LinkedIn profile: https://www.linkedin.com/company/pt-aj-sequis-financial
Feb 25 12:53:50 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:53:50.254Z (scraping-posts) (1582610028799): LinkedIn profile page loaded!
Feb 25 12:53:50 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:53:50.255Z (scraping-posts) (1582610028799): Getting all the LinkedIn profile data by scrolling the page to the bottom, so all the data gets loaded into the page...
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:53:55.846Z (scraping-posts) (1582610028799): Parsing data...
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]: 2020-02-25T05:53:55.847Z (scraping-posts) (1582610028799): Expanding all sections by clicking their "See more" buttons
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]: (node:4296) UnhandledPromiseRejectionWarning: Error: Evaluation failed: TypeError: Cannot read property 'replace' of undefined
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at __puppeteer_evaluation_script__:32:37
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at Array.map (<anonymous>)
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at __puppeteer_evaluation_script__:2:92
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at new Promise (<anonymous>)
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at __puppeteer_evaluation_script__:1:8
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at ExecutionContext._evaluateInternal (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/ExecutionContext.js:122:13)
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at <anonymous>
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at process._tickCallback (internal/process/next_tick.js:188:7)
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:   -- ASYNC --
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at ExecutionContext.<anonymous> (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/helper.js:111:15)
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at DOMWorld.evaluate (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/DOMWorld.js:112:20)
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at <anonymous>
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at process._tickCallback (internal/process/next_tick.js:188:7)
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:   -- ASYNC --
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at Frame.<anonymous> (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/helper.js:111:15)
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at Page.evaluate (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/Page.js:833:43)
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at Page.<anonymous> (/home/bino/app/social-crawler-js/node_modules/puppeteer/lib/helper.js:112:23)
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at getLinkedinPost (/home/bino/app/social-crawler-js/scraper/linkedin.js:228:30)
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at <anonymous>
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]:     at process._tickCallback (internal/process/next_tick.js:188:7)
Feb 25 12:53:55 social-crawler-2 linkedin_crawler[4268]: (node:4296) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 4)