MLDZ

Untitled

Mar 5th, 2021
772
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. /Users/maxim/Downloads/Seo_parser-main/venv/bin/python /Users/maxim/Downloads/Seo_parser-main/manage.py runserver 8000
  2. Performing system checks...
  3.  
  4. System check identified no issues (0 silenced).
  5. March 05, 2021 - 07:39:58
  6. Django version 2.1.5, using settings 'seo_parser.settings'
  7. Starting development server at http://127.0.0.1:8000/
  8. Quit the server with CONTROL-C.
  9. [05/Mar/2021 07:40:05] "GET / HTTP/1.1" 200 4468
  10. [05/Mar/2021 07:40:05] "GET /static/js/common.js HTTP/1.1" 200 4769
  11. [05/Mar/2021 07:40:05] "GET /static/img/logo.png HTTP/1.1" 200 5011
  12. [05/Mar/2021 07:40:05] "GET /static/js/libs.min.js HTTP/1.1" 200 123809
  13. [05/Mar/2021 07:40:05] "GET /static/fonts/HelveticaNeue.woff HTTP/1.1" 200 216580
  14. 2021-03-05 07:40:16 [scrapy.utils.log] INFO: Scrapy 2.4.1 started (bot: spider_seo)
  15. 2021-03-05 07:40:16 [scrapy.utils.log] INFO: Versions: lxml 4.6.2.0, libxml2 2.9.10, cssselect 1.1.0, parsel 1.6.0, w3lib 1.22.0, Twisted 20.3.0, Python 3.9.0 (default, Nov 21 2020, 12:10:04) - [Clang 12.0.0 (clang-1200.0.32.27)], pyOpenSSL 20.0.1 (OpenSSL 1.1.1i  8 Dec 2020), cryptography 3.4.4, Platform macOS-11.2.1-x86_64-i386-64bit
  16. 2021-03-05 07:40:16 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.selectreactor.SelectReactor
  17. 2021-03-05 07:40:16 [scrapy.crawler] INFO: Overridden settings:
  18. {'BOT_NAME': 'spider_seo',
  19.  'NEWSPIDER_MODULE': 'spider_seo.spiders',
  20.  'ROBOTSTXT_OBEY': True,
  21.  'SPIDER_MODULES': ['spider_seo.spiders']}
  22. 2021-03-05 07:40:16 [scrapy.extensions.telnet] INFO: Telnet Password: daaff3f20c4df4d0
  23. 2021-03-05 07:40:16 [scrapy.middleware] INFO: Enabled extensions:
  24. ['scrapy.extensions.corestats.CoreStats',
  25.  'scrapy.extensions.telnet.TelnetConsole',
  26.  'scrapy.extensions.memusage.MemoryUsage',
  27.  'scrapy.extensions.logstats.LogStats']
  28. 2021-03-05 07:40:16 [scrapy.middleware] INFO: Enabled downloader middlewares:
  29. ['scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware',
  30.  'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
  31.  'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
  32.  'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
  33.  'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
  34.  'scrapy.downloadermiddlewares.retry.RetryMiddleware',
  35.  'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
  36.  'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
  37.  'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
  38.  'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
  39.  'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
  40.  'scrapy.downloadermiddlewares.stats.DownloaderStats']
  41. 2021-03-05 07:40:16 [scrapy.middleware] INFO: Enabled spider middlewares:
  42. ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
  43.  'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
  44.  'scrapy.spidermiddlewares.referer.RefererMiddleware',
  45.  'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
  46.  'scrapy.spidermiddlewares.depth.DepthMiddleware']
  47. 2021-03-05 07:40:16 [scrapy.middleware] INFO: Enabled item pipelines:
  48. ['spider_seo.pipelines.SpiderSeoPipeline']
  49. 2021-03-05 07:40:16 [scrapy.core.engine] INFO: Spider opened
  50. 2021-03-05 07:40:16 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
  51. 2021-03-05 07:40:16 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
  52. 2021-03-05 07:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://dulevo.ru/robots.txt> (referer: None)
  53. 2021-03-05 07:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://dulevo.ru> (referer: None)
  54. 2021-03-05 07:40:17 [scrapy.spidermiddlewares.offsite] DEBUG: Filtered offsite request to 'dulevo.ru': <GET https://dulevo.ru>
  55. 2021-03-05 07:40:17 [scrapy.spidermiddlewares.offsite] DEBUG: Filtered offsite request to 'www.instagram.com': <GET https://www.instagram.com/dulevskiy.farfor>
  56. 2021-03-05 07:40:17 [scrapy.spidermiddlewares.offsite] DEBUG: Filtered offsite request to 'www.facebook.com': <GET https://www.facebook.com/dulevoporcelain>
  57. 2021-03-05 07:40:17 [scrapy.spidermiddlewares.offsite] DEBUG: Filtered offsite request to 'dfz.ru': <GET http://dfz.ru/master-klassy/>
  58. 2021-03-05 07:40:17 [scrapy.spidermiddlewares.offsite] DEBUG: Filtered offsite request to 'legeart.pro': <GET https://legeart.pro/>
  59. 2021-03-05 07:40:17 [scrapy.core.engine] INFO: Closing spider (finished)
  60. 2021-03-05 07:40:17 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
  61. {'downloader/request_bytes': 428,
  62.  'downloader/request_count': 2,
  63.  'downloader/request_method_count/GET': 2,
  64.  'downloader/response_bytes': 23680,
  65.  'downloader/response_count': 2,
  66.  'downloader/response_status_count/200': 2,
  67.  'elapsed_time_seconds': 0.440818,
  68.  'finish_reason': 'finished',
  69.  'finish_time': datetime.datetime(2021, 3, 5, 7, 40, 17, 371939),
  70.  'log_count/DEBUG': 7,
  71.  'log_count/INFO': 10,
  72.  'memusage/max': 57884672,
  73.  'memusage/startup': 57880576,
  74.  'offsite/domains': 5,
  75.  'offsite/filtered': 102,
  76.  'request_depth_max': 1,
  77.  'response_received_count': 2,
  78.  'robotstxt/request_count': 1,
  79.  'robotstxt/response_count': 1,
  80.  'robotstxt/response_status_count/200': 1,
  81.  'scheduler/dequeued': 1,
  82.  'scheduler/dequeued/memory': 1,
  83.  'scheduler/enqueued': 1,
  84.  'scheduler/enqueued/memory': 1,
  85.  'start_time': datetime.datetime(2021, 3, 5, 7, 40, 16, 931121)}
  86. 2021-03-05 07:40:17 [scrapy.core.engine] INFO: Spider closed (finished)
  87. [05/Mar/2021 07:40:17] "POST / HTTP/1.1" 302 0
  88. [05/Mar/2021 07:40:17] "GET /result/ HTTP/1.1" 200 24910
  89. [05/Mar/2021 07:40:17] "GET /static/questions/img/logo.gif HTTP/1.1" 404 1690
  90.  
RAW Paste Data

Adblocker detected! Please consider disabling it...

We've detected AdBlock Plus or some other adblocking software preventing Pastebin.com from fully loading.

We don't have any obnoxious sound, or popup ads, we actively block these annoying types of ads!

Please add Pastebin.com to your ad blocker whitelist or disable your adblocking software.

×