lamiastella

scrapy.Spider

Mar 1st, 2017
453
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 8.82 KB | None | 0 0
  1. mona@pascal:~/computer_vision/instagram/instagram$ sudo pip install scrapy --upgrade
  2. [sudo] password for mona:
  3. The directory '/home/mona/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
  4. The directory '/home/mona/.cache/pip' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
  5. Collecting scrapy
  6. Downloading Scrapy-1.3.2-py2.py3-none-any.whl (239kB)
  7. 100% |████████████████████████████████| 245kB 1.9MB/s
  8. Collecting service-identity (from scrapy)
  9. Downloading service_identity-16.0.0-py2.py3-none-any.whl
  10. Collecting cssselect>=0.9 (from scrapy)
  11. Downloading cssselect-1.0.1-py2.py3-none-any.whl
  12. Collecting pyOpenSSL (from scrapy)
  13. Downloading pyOpenSSL-16.2.0-py2.py3-none-any.whl (43kB)
  14. 100% |████████████████████████████████| 51kB 2.8MB/s
  15. Requirement already up-to-date: six>=1.5.2 in /usr/local/lib/python3.4/dist-packages (from scrapy)
  16. Collecting w3lib>=1.15.0 (from scrapy)
  17. Downloading w3lib-1.17.0-py2.py3-none-any.whl
  18. Collecting parsel>=1.1 (from scrapy)
  19. Downloading parsel-1.1.0-py2.py3-none-any.whl
  20. Collecting queuelib (from scrapy)
  21. Downloading queuelib-1.4.2-py2.py3-none-any.whl
  22. Collecting PyDispatcher>=2.0.5 (from scrapy)
  23. Requirement already up-to-date: Twisted>=13.1.0 in /usr/local/lib/python3.4/dist-packages (from scrapy)
  24. Collecting lxml (from scrapy)
  25. Downloading lxml-3.7.3-cp34-cp34m-manylinux1_x86_64.whl (7.2MB)
  26. 100% |████████████████████████████████| 7.2MB 155kB/s
  27. Collecting pyasn1 (from service-identity->scrapy)
  28. Downloading pyasn1-0.2.3-py2.py3-none-any.whl (53kB)
  29. 100% |████████████████████████████████| 61kB 6.6MB/s
  30. Collecting pyasn1-modules (from service-identity->scrapy)
  31. Downloading pyasn1_modules-0.0.8-py2.py3-none-any.whl
  32. Requirement already up-to-date: attrs in /usr/local/lib/python3.4/dist-packages (from service-identity->scrapy)
  33. Collecting cryptography>=1.3.4 (from pyOpenSSL->scrapy)
  34. Requirement already up-to-date: zope.interface>=4.0.2 in /usr/local/lib/python3.4/dist-packages (from Twisted>=13.1.0->scrapy)
  35. Requirement already up-to-date: Automat>=0.3.0 in /usr/local/lib/python3.4/dist-packages (from Twisted>=13.1.0->scrapy)
  36. Requirement already up-to-date: constantly>=15.1 in /usr/local/lib/python3.4/dist-packages (from Twisted>=13.1.0->scrapy)
  37. Requirement already up-to-date: incremental>=16.10.1 in /usr/local/lib/python3.4/dist-packages (from Twisted>=13.1.0->scrapy)
  38. Requirement already up-to-date: cffi>=1.4.1 in /usr/local/lib/python3.4/dist-packages (from cryptography>=1.3.4->pyOpenSSL->scrapy)
  39. Collecting idna>=2.0 (from cryptography>=1.3.4->pyOpenSSL->scrapy)
  40. Downloading idna-2.4-py2.py3-none-any.whl (55kB)
  41. 100% |████████████████████████████████| 61kB 5.3MB/s
  42. Collecting setuptools>=11.3 (from cryptography>=1.3.4->pyOpenSSL->scrapy)
  43. Downloading setuptools-34.3.0-py2.py3-none-any.whl (389kB)
  44. 100% |████████████████████████████████| 399kB 2.5MB/s
  45. Requirement already up-to-date: pycparser in /usr/local/lib/python3.4/dist-packages (from cffi>=1.4.1->cryptography>=1.3.4->pyOpenSSL->scrapy)
  46. Collecting appdirs>=1.4.0 (from setuptools>=11.3->cryptography>=1.3.4->pyOpenSSL->scrapy)
  47. Downloading appdirs-1.4.2-py2.py3-none-any.whl
  48. Collecting packaging>=16.8 (from setuptools>=11.3->cryptography>=1.3.4->pyOpenSSL->scrapy)
  49. Downloading packaging-16.8-py2.py3-none-any.whl
  50. Collecting pyparsing (from packaging>=16.8->setuptools>=11.3->cryptography>=1.3.4->pyOpenSSL->scrapy)
  51. Downloading pyparsing-2.1.10-py2.py3-none-any.whl (56kB)
  52. 100% |████████████████████████████████| 61kB 7.1MB/s
  53. Installing collected packages: pyasn1, pyasn1-modules, idna, appdirs, pyparsing, packaging, setuptools, cryptography, pyOpenSSL, service-identity, cssselect, w3lib, lxml, parsel, queuelib, PyDispatcher, scrapy
  54. Found existing installation: setuptools 33.1.1
  55. Uninstalling setuptools-33.1.1:
  56. Successfully uninstalled setuptools-33.1.1
  57. Successfully installed PyDispatcher-2.0.5 appdirs-1.4.2 cryptography-1.7.2 cssselect-1.0.1 idna-2.4 lxml-3.7.3 packaging-16.8 parsel-1.1.0 pyOpenSSL-16.2.0 pyasn1-0.2.3 pyasn1-modules-0.0.8 pyparsing-2.1.10 queuelib-1.4.2 scrapy-1.3.2 service-identity-16.0.0 setuptools-34.3.0 w3lib-1.17.0
  58. mona@pascal:~/computer_vision/instagram/instagram$ scrapy crawl instagramspider
  59. 2017-03-01 17:41:13-0600 [scrapy] INFO: Scrapy 0.14.4 started (bot: instagram)
  60. 2017-03-01 17:41:13-0600 [scrapy] DEBUG: Enabled extensions: LogStats, TelnetConsole, CloseSpider, WebService, CoreStats, MemoryUsage, SpiderState
  61. /usr/lib/python2.7/dist-packages/scrapy/__init__.pyc
  62. Traceback (most recent call last):
  63. File "/usr/bin/scrapy", line 4, in <module>
  64. execute()
  65. File "/usr/lib/python2.7/dist-packages/scrapy/cmdline.py", line 132, in execute
  66. _run_print_help(parser, _run_command, cmd, args, opts)
  67. File "/usr/lib/python2.7/dist-packages/scrapy/cmdline.py", line 97, in _run_print_help
  68. func(*a, **kw)
  69. File "/usr/lib/python2.7/dist-packages/scrapy/cmdline.py", line 139, in _run_command
  70. cmd.run(args, opts)
  71. File "/usr/lib/python2.7/dist-packages/scrapy/commands/crawl.py", line 43, in run
  72. spider = self.crawler.spiders.create(spname, **opts.spargs)
  73. File "/usr/lib/python2.7/dist-packages/scrapy/command.py", line 34, in crawler
  74. self._crawler.configure()
  75. File "/usr/lib/python2.7/dist-packages/scrapy/crawler.py", line 36, in configure
  76. self.spiders = spman_cls.from_crawler(self)
  77. File "/usr/lib/python2.7/dist-packages/scrapy/spidermanager.py", line 37, in from_crawler
  78. return cls.from_settings(crawler.settings)
  79. File "/usr/lib/python2.7/dist-packages/scrapy/spidermanager.py", line 33, in from_settings
  80. return cls(settings.getlist('SPIDER_MODULES'))
  81. File "/usr/lib/python2.7/dist-packages/scrapy/spidermanager.py", line 23, in __init__
  82. for module in walk_modules(name):
  83. File "/usr/lib/python2.7/dist-packages/scrapy/utils/misc.py", line 65, in walk_modules
  84. submod = __import__(fullpath, {}, {}, [''])
  85. File "/home/mona/computer_vision/instagram/instagram/instagram/spiders/spider.py", line 3, in <module>
  86. from scrapy import Spider
  87. ImportError: cannot import name Spider
  88. mona@pascal:~/computer_vision/instagram/instagram$ vi /home/mona/computer_vision/instagram/instagram/instagram/spiders/spider.py
  89. mona@pascal:~/computer_vision/instagram/instagram$ scrapy crawl instagramspider
  90. 2017-03-01 17:41:43-0600 [scrapy] INFO: Scrapy 0.14.4 started (bot: instagram)
  91. 2017-03-01 17:41:43-0600 [scrapy] DEBUG: Enabled extensions: LogStats, TelnetConsole, CloseSpider, WebService, CoreStats, MemoryUsage, SpiderState
  92. /usr/lib/python2.7/dist-packages/scrapy/__init__.pyc
  93. Traceback (most recent call last):
  94. File "/usr/bin/scrapy", line 4, in <module>
  95. execute()
  96. File "/usr/lib/python2.7/dist-packages/scrapy/cmdline.py", line 132, in execute
  97. _run_print_help(parser, _run_command, cmd, args, opts)
  98. File "/usr/lib/python2.7/dist-packages/scrapy/cmdline.py", line 97, in _run_print_help
  99. func(*a, **kw)
  100. File "/usr/lib/python2.7/dist-packages/scrapy/cmdline.py", line 139, in _run_command
  101. cmd.run(args, opts)
  102. File "/usr/lib/python2.7/dist-packages/scrapy/commands/crawl.py", line 43, in run
  103. spider = self.crawler.spiders.create(spname, **opts.spargs)
  104. File "/usr/lib/python2.7/dist-packages/scrapy/command.py", line 34, in crawler
  105. self._crawler.configure()
  106. File "/usr/lib/python2.7/dist-packages/scrapy/crawler.py", line 36, in configure
  107. self.spiders = spman_cls.from_crawler(self)
  108. File "/usr/lib/python2.7/dist-packages/scrapy/spidermanager.py", line 37, in from_crawler
  109. return cls.from_settings(crawler.settings)
  110. File "/usr/lib/python2.7/dist-packages/scrapy/spidermanager.py", line 33, in from_settings
  111. return cls(settings.getlist('SPIDER_MODULES'))
  112. File "/usr/lib/python2.7/dist-packages/scrapy/spidermanager.py", line 23, in __init__
  113. for module in walk_modules(name):
  114. File "/usr/lib/python2.7/dist-packages/scrapy/utils/misc.py", line 65, in walk_modules
  115. submod = __import__(fullpath, {}, {}, [''])
  116. File "/home/mona/computer_vision/instagram/instagram/instagram/spiders/spider.py", line 8, in <module>
  117. class InstagramSpider(scrapy.Spider):
  118. AttributeError: 'module' object has no attribute 'Spider'
Advertisement
Add Comment
Please, Sign In to add comment