frontera.worker.strategy

python -m frontera.worker.strategy --config frontier.strategy0  --strategy frontera.worker.strategies.bfs
[manager] --------------------------------------------------------------------------------
[manager] Starting Frontier Manager...
[manager] Loading middleware 'frontera.contrib.middlewares.fingerprint.UrlFingerprintMiddleware'
[manager] Loading middleware 'frontera.contrib.middlewares.domain.DomainMiddleware'
[manager] Loading middleware 'frontera.contrib.middlewares.fingerprint.DomainFingerprintMiddleware'
[manager] Loading canonical url solver 'frontera.contrib.canonicalsolvers.Basic'
[manager] Loading backend 'frontera.contrib.backends.sqlalchemy.Distributed'
[manager] --------------------------------------------------------------------------------
[manager] Starting Frontier Manager...
[manager] Test mode DISABLED
[manager] Loading event log manager 'frontera.logger.events.EventLogManager'
[manager] Frontier Manager Started!
[manager] --------------------------------------------------------------------------------
[manager] (0) START
[strategy-worker] Consumed 0 items.
[strategy-worker] Consumed 0 items.
[strategy-worker] Consumed 0 items.
[strategy-worker] Flushing states
[strategy-worker] Flushing states finished
[strategy-worker] Consumed 0 items.
Unhandled error in Deferred:


Traceback (most recent call last):
  File "/home/hadoop/.local/lib/python2.7/site-packages/twisted/internet/base.py", line 1194, in run
    self.mainLoop()
  File "/home/hadoop/.local/lib/python2.7/site-packages/twisted/internet/base.py", line 1203, in mainLoop
    self.runUntilCurrent()
  File "/home/hadoop/.local/lib/python2.7/site-packages/twisted/internet/base.py", line 825, in runUntilCurrent
    call.func(*call.args, **call.kw)
  File "/home/hadoop/.local/lib/python2.7/site-packages/twisted/internet/task.py", line 239, in __call__
    d = defer.maybeDeferred(self.f, *self.a, **self.kw)
--- <exception caught here> ---
  File "/home/hadoop/.local/lib/python2.7/site-packages/twisted/internet/defer.py", line 150, in maybeDeferred
    result = f(*args, **kw)
  File "/home/hadoop/.local/lib/python2.7/site-packages/frontera/worker/strategy.py", line 51, in work
    msg = self._decoder.decode(m)
  File "/home/hadoop/.local/lib/python2.7/site-packages/frontera/contrib/backends/remote/codecs/msgpack.py", line 79, in decode
    obj = unpackb(buffer)
  File "msgpack/_unpacker.pyx", line 143, in msgpack._unpacker.unpackb (msgpack/_unpacker.cpp:143)

msgpack.exceptions.ExtraData: unpack(b) received extra data.