C:\allenheath>scrapy crawl products -o allenheath.csv
2015-04-30 09:48:15-0700 [scrapy] INFO: Scrapy 0.24.6 started (bot: allenheath)
2015-04-30 09:48:15-0700 [scrapy] INFO: Optional features available: ssl, http11

2015-04-30 09:48:15-0700 [scrapy] INFO: Overridden settings: {'NEWSPIDER_MODULE'
: 'allenheath.spiders', 'FEED_FORMAT': 'csv', 'SPIDER_MODULES': ['allenheath.spi
ders'], 'FEED_URI': 'allenheath.csv', 'BOT_NAME': 'allenheath'}
2015-04-30 09:48:15-0700 [scrapy] INFO: Enabled extensions: FeedExporter, LogSta
ts, TelnetConsole, CloseSpider, WebService, CoreStats, SpiderState
2015-04-30 09:48:16-0700 [scrapy] INFO: Enabled downloader middlewares: HttpAuth
Middleware, DownloadTimeoutMiddleware, UserAgentMiddleware, RetryMiddleware, Def
aultHeadersMiddleware, MetaRefreshMiddleware, HttpCompressionMiddleware, Redirec
tMiddleware, CookiesMiddleware, ChunkedTransferMiddleware, DownloaderStats
2015-04-30 09:48:16-0700 [scrapy] INFO: Enabled spider middlewares: HttpErrorMid
dleware, OffsiteMiddleware, RefererMiddleware, UrlLengthMiddleware, DepthMiddlew
are
2015-04-30 09:48:16-0700 [scrapy] INFO: Enabled item pipelines: ImagesPipeline
2015-04-30 09:48:16-0700 [products] INFO: Spider opened
2015-04-30 09:48:16-0700 [products] INFO: Crawled 0 pages (at 0 pages/min), scra
ped 0 items (at 0 items/min)
2015-04-30 09:48:16-0700 [scrapy] DEBUG: Telnet console listening on 127.0.0.1:6
025
2015-04-30 09:48:16-0700 [scrapy] DEBUG: Web service listening on 127.0.0.1:6082

2015-04-30 09:48:17-0700 [products] DEBUG: Crawled (200) <GET http://www.allen-h
eath.com/ahproducts/ilive-80/> (referer: None)
2015-04-30 09:48:17-0700 [products] DEBUG: Crawled (200) <GET http://www.allen-h
eath.com/ahproducts/ilive-112/> (referer: None)
2015-04-30 09:48:18-0700 [products] DEBUG: Crawled (200) <GET http://www.allen-h
eath.com/media/iLive_80_3Q_Main.jpg> (referer: None)
2015-04-30 09:48:18-0700 [products] DEBUG: File (downloaded): Downloaded file fr
om <GET http://www.allen-heath.com/media/iLive_80_3Q_Main.jpg> referred in <None
>
2015-04-30 09:48:18-0700 [products] DEBUG: Scraped from <200 http://www.allen-he
ath.com/ahproducts/ilive-80/>
        {'desc': [u'<div id="productcontent">\n\n\n<div class="row">\n\n<div cla
ss="col-sm-9">\n<h1>iLive-80 OVERVIEW</h1>\n<div id="product-text">\n<div><span
style="font-family: Arial;">The Surface is simply a controller for the MixRack.
It also has an audio rack built into it to conveniently provide local inputs and
 outputs at the mix position. It features a large analogue style, one control pe
r function processing block, TouchScreen, name and colour virtual \u2018write-on
\u2019 strip, banks of motorised faders with independent layers, SoftKeys, built
-in headphones, local monitor and talkback. The modular iLive-80 allows a variet
y of audio I/O modules, network formats and redundant power supply options, and
can be shipped in a touring flight case.</span></div>\n</div>\n<p><img class="al
ignnone size-full wp-image-5599" src="http://www.allen-heath.com/media/iLive_80_
3Q_Main.jpg" alt="iLive_80_3Q_Main" width="770" height="448"></p>\n<p>\xa0</p>\n
<h2>FEATURE SUMMARY</h2>\n<ul>\n<li>Smallest modular Surface</li>\n<li>20 faders
 \u2013 2 banks, 4 layers = 80 control strips</li>\n<li>Up to 32 audio sockets</
li>\n<li>Wide range of I/O module options</li>\n<li>Optional RAB2 module with Po
rt A and Port B network options</li>\n<li>Choose\xa0network option for\xa0Port A
 MixRack link</li>\n<li>Port B can be loaded with M-MMO card option</li>\n<li>Bu
ilt in 3 port Ethernet switch</li>\n<li>MIDI and PL-Anet ports</li>\n<li>Word cl
ock interface</li>\n<li>Socket LED indicators for 48V, Mute and PAFL</li>\n<li>E
xternal iPS10 redundant power supply option</li>\n<li>Touring grade flight case<
/li>\n</ul>\n</div>\n\n<div class="col-sm-3 mobnoshow">\n<h3>NEWS</h3>\n<p><a hr
ef="http://www.allen-heath.com/media/LSI-May-Cover-Broken-Bells-feature.pdf" tar
get="_blank"><img class="alignnone size-full wp-image-7569" src="http://www.alle
n-heath.com/media/DaveMcDonald_LSI_Side.jpg" alt="DaveMcDonald_LSI_Side" width="
247" height="165"></a></p>\n<p>\xa0</p>\n<h3>Community</h3>\n<p><a href="http://
community.allen-heath.com/" target="_blank"><img class="alignnone size-full wp-i
mage-6137" style="border: 4px solid black;" src="http://www.allen-heath.com/medi
a/RB_digital_community.jpg" alt="RB_digital_community" width="320" height="218">
</a></p>\n<p>\xa0</p>\n<h3>Firmware V1.92</h3>\n<p><a href="/ahproducts/ilive-80
#tab5"><img class="alignnone size-full wp-image-6174" style="border: 4px solid b
lack;" src="http://www.allen-heath.com/media/RB_iLive_Firrmware_V1.92.jpg" alt="
RB_iLive_Firrmware_V1.92" width="320" height="202"></a></p>\n<p>\xa0</p>\n<h3>iL
ive FX</h3>\n<p><a href="/key-series/ilive-fxprocessing/"><img style="border: 4p
x solid black;" src="http://www.allen-heath.com/media/ilivefx.jpg" alt="iLive FX
" width="320" height="225"></a></p>\n</div>\n\n</div>\n\n\n</div>'],
         'image_urls': [u'http://www.allen-heath.com/media/iLive_80_3Q_Main.jpg'
],
         'imageorig': [u'iLive-80'],
         'images': [{'checksum': '7b2502598890e6c54174f11e0b30cd1c',
                     'path': 'full/b77deade17742e27c71cea04b76185d28bddcc02.jpg'
,
                     'url': 'http://www.allen-heath.com/media/iLive_80_3Q_Main.j
pg'}],
         'model': [u'iLive-80'],
         'series': [u'iLive Series'],
         'shortdesc': [u'Modular \u2013 20 Faders']}
2015-04-30 09:48:18-0700 [products] DEBUG: Crawled (200) <GET http://www.allen-h
eath.com/media/iLive_112_3Q_Main.jpg> (referer: None)
2015-04-30 09:48:18-0700 [products] DEBUG: File (downloaded): Downloaded file fr
om <GET http://www.allen-heath.com/media/iLive_112_3Q_Main.jpg> referred in <Non
e>
2015-04-30 09:48:18-0700 [products] DEBUG: Scraped from <200 http://www.allen-he
ath.com/ahproducts/ilive-112/>
        {'desc': [u'<div id="productcontent">\n\n\n<div class="row">\n\n<div cla
ss="col-sm-9">\n<h1>iLive-112 OVERVIEW</h1>\n<div id="product-text">\n<div><span
 style="font-family: Arial;"><span style="font-family: Arial;">The Surface is si
mply a controller for the MixRack. It also has an audio rack built into it to co
nveniently provide local inputs and outputs at the mix position. It features a l
arge analogue style, one control per function processing block, TouchScreen, nam
e and colour virtual \u2018write-on\u2019 strip, banks of motorised faders with
independent layers, SoftKeys, built-in headphones, local monitor and talkback. T
he modular iLive-112 allows a variety of audio I/O modules, network formats and
redundant power supply options, and is shipped in a touring flight case.</span><
/span></div>\n</div>\n<p><img class="alignnone size-full wp-image-5600" src="htt
p://www.allen-heath.com/media/iLive_112_3Q_Main.jpg" alt="iLive_112_3Q_Main" wid
th="770" height="370"></p>\n<p>\xa0</p>\n<h2>FEATURE SUMMARY</h2>\n<ul>\n<li>Sma
ll footprint modular Surface</li>\n<li>28 faders \u2013 3 banks, 4 layers = 112
control strips</li>\n<li>Up to 32 audio sockets</li>\n<li>Wide range of I/O modu
le options</li>\n<li>Optional RAB2 module with Port A and Port B network options
</li>\n<li>Choose network option for Port A MixRack link</li>\n<li>Port B can be
 loaded with M-MMO card option</li>\n<li>Built in 3 port Ethernet switch</li>\n<
li>MIDI and PL-Anet ports</li>\n<li>Word clock interface</li>\n<li>Socket LED in
dicators for 48V, Mute and PAFL</li>\n<li>External iPS10 redundant power supply
option</li>\n<li>Touring grade flight case</li>\n</ul>\n</div>\n\n<div class="co
l-sm-3 mobnoshow">\n<h3>NEWS</h3>\n<p><a href="http://www.allen-heath.com/media/
LSI-May-Cover-Broken-Bells-feature.pdf" target="_blank"><img class="alignnone si
ze-full wp-image-7569" src="http://www.allen-heath.com/media/DaveMcDonald_LSI_Si
de.jpg" alt="DaveMcDonald_LSI_Side" width="247" height="165"></a></p>\n<h3>Commu
nity</h3>\n<p><a href="http://community.allen-heath.com/" target="_blank"><img c
lass="alignnone size-full wp-image-6137" style="border: 4px solid black;" src="h
ttp://www.allen-heath.com/media/RB_digital_community.jpg" alt="RB_digital_commun
ity" width="320" height="218"></a></p>\n<h3>Firmware V1.92</h3>\n<p><a href="/ah
products/ilive-112#tab5"><img class="alignnone size-full wp-image-6174" style="b
order: 4px solid black;" src="http://www.allen-heath.com/media/RB_iLive_Firrmwar
e_V1.92.jpg" alt="RB_iLive_Firrmware_V1.92" width="320" height="202"></a></p>\n<
h3>iLive FX</h3>\n<p><a href="/key-series/ilive-fxprocessing/"><img style="borde
r: 4px solid black;" src="http://www.allen-heath.com/media/ilivefx.jpg" alt="iLi
ve FX" width="320" height="225"></a></p>\n</div>\n\n</div>\n\n\n</div>'],
         'image_urls': [u'http://www.allen-heath.com/media/iLive_112_3Q_Main.jpg
'],
         'imageorig': [u'iLive-112'],
         'images': [{'checksum': '0efd32af9cea6a2a336431f920d6ee28',
                     'path': 'full/0e37501fa04028d267a22971bc8fd7725811026b.jpg'
,
                     'url': 'http://www.allen-heath.com/media/iLive_112_3Q_Main.
jpg'}],
         'model': [u'iLive-112'],
         'series': [u'iLive Series'],
         'shortdesc': [u'Modular \u2013 28 Faders']}
2015-04-30 09:48:18-0700 [products] INFO: Closing spider (finished)
2015-04-30 09:48:18-0700 [products] INFO: Stored csv feed (2 items) in: allenhea
th.csv
2015-04-30 09:48:18-0700 [products] INFO: Dumping Scrapy stats:
        {'downloader/request_bytes': 966,
         'downloader/request_count': 4,
         'downloader/request_method_count/GET': 4,
         'downloader/response_bytes': 127486,
         'downloader/response_count': 4,
         'downloader/response_status_count/200': 4,
         'file_count': 2,
         'file_status_count/downloaded': 2,
         'finish_reason': 'finished',
         'finish_time': datetime.datetime(2015, 4, 30, 16, 48, 18, 275000),
         'item_scraped_count': 2,
         'log_count/DEBUG': 10,
         'log_count/INFO': 8,
         'response_received_count': 4,
         'scheduler/dequeued': 2,
         'scheduler/dequeued/memory': 2,
         'scheduler/enqueued': 2,
         'scheduler/enqueued/memory': 2,
         'start_time': datetime.datetime(2015, 4, 30, 16, 48, 16, 266000)}
2015-04-30 09:48:18-0700 [products] INFO: Spider closed (finished)

C:\allenheath>