Advertisement
Guest User

Untitled

a guest
Nov 23rd, 2017
79
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 2.26 KB | None | 0 0
  1. ---this happened when initially writing a symbol---
  2.  
  3. Traceback (most recent call last):
  4. ...
  5. File "myProgram.py", line 102, in saveData
  6. lib.write(key, df, {'start': data[0]['date'], 'end': data[len(data)-1]['date'] }, chunk_size=chunkSize)
  7. File ".../arctic/chunkstore/chunkstore.py", line 351, in write
  8. data = self.serializer.serialize(record)
  9. File ".../arctic/serialization/numpy_arrays.py", line 176, in serialize
  10. ret = self.converter.docify(df)
  11. File ".../arctic/serialization/numpy_arrays.py", line 115, in docify
  12. raise e
  13. File ".../arctic/serialization/numpy_arrays.py", line 106, in docify
  14. arr, mask = self._convert_types(df[c].values)
  15. File ".../arctic/serialization/numpy_arrays.py", line 82, in _convert_types
  16. return a.astype('U{:d}'.format(max_len)), mask
  17. MemoryError
  18.  
  19.  
  20. ---another run, where this time the initial write succeeded, but updating it failed---
  21.  
  22.  
  23. Traceback (most recent call last):
  24. ...
  25. File "myProgram.py", line 97, in saveData
  26. lib.append(key, getDataFrame(data[trimIndex:]), metadata)
  27. File ".../arctic/chunkstore/chunkstore.py", line 511, in append
  28. self.__update(sym, item, metadata=metadata, combine_method=SER_MAP[sym[SERIALIZER]].combine, audit=audit)
  29. File ".../arctic/chunkstore/chunkstore.py", line 427, in __update
  30. df = self.read(symbol, chunk_range=chunker.to_range(start, end), filter_data=False)
  31. File ".../arctic/chunkstore/chunkstore.py", line 284, in read
  32. return deser(chunks[symbol[0]], **kwargs) if skip_filter else chunker.filter(deser(chunks[symbol[0]], **kwargs), chunk_range)
  33. File ".../arctic/serialization/numpy_arrays.py", line 210, in deserialize
  34. df = pd.concat([self.converter.objify(d, columns) for d in data], ignore_index=not index)
  35. File ".../arctic/serialization/numpy_arrays.py", line 210, in <listcomp>
  36. df = pd.concat([self.converter.objify(d, columns) for d in data], ignore_index=not index)
  37. File ".../arctic/serialization/numpy_arrays.py", line 141, in objify
  38. d = decompress(doc[DATA][doc[METADATA][LENGTHS][col][0]: doc[METADATA][LENGTHS][col][1] + 1])
  39. File ".../arctic/_compression.py", line 55, in decompress
  40. return clz4.decompress(_str)
  41. File "src/_compress.pyx", line 121, in _compress.decompress
  42. Exception: Error decompressing
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement