Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: osd/ECBackend.cc: In function 'virtual void OnRecoveryReadComplete::finish(std::pair<RecoveryMessages*, ECBackend::read_result_t&>&)' t
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: osd/ECBackend.cc: 203: FAILED assert(res.errors.empty())
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: ceph version 10.2.2 (45107e21c568dd033c2f0a3107dec8f0b0e58374)
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f4f9d6cb5b5]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 2: (OnRecoveryReadComplete::finish(std::pair<RecoveryMessages*, ECBackend::read_result_t&>&)+0x192) [0x7f4f9d26a982]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 3: (GenContext<std::pair<RecoveryMessages*, ECBackend::read_result_t&>&>::complete(std::pair<RecoveryMessages*, ECBackend::read_result_
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 4: (ECBackend::complete_read_op(ECBackend::ReadOp&, RecoveryMessages*)+0x73) [0x7f4f9d24e043]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 5: (ECBackend::handle_sub_read_reply(pg_shard_t, ECSubReadReply&, RecoveryMessages*)+0xfe9) [0x7f4f9d24f0b9]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 6: (ECBackend::handle_message(std::shared_ptr<OpRequest>)+0x1a3) [0x7f4f9d256513]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 7: (ReplicatedPG::do_request(std::shared_ptr<OpRequest>&, ThreadPool::TPHandle&)+0x100) [0x7f4f9d18b810]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 8: (OSD::dequeue_op(boost::intrusive_ptr<PG>, std::shared_ptr<OpRequest>, ThreadPool::TPHandle&)+0x41d) [0x7f4f9d040a8d]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 9: (PGQueueable::RunVis::operator()(std::shared_ptr<OpRequest>&)+0x6d) [0x7f4f9d040cdd]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x869) [0x7f4f9d045809]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x887) [0x7f4f9d6bb557]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x7f4f9d6bd4c0]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 13: (()+0x7dc5) [0x7f4f9b5f9dc5]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 14: (clone()+0x6d) [0x7f4f99c84ced]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 2016-07-20 20:04:32.951185 7f4f7ac52700 -1 osd/ECBackend.cc: In function 'virtual void OnRecoveryReadComplete::finish(std::pair<Recover
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: osd/ECBackend.cc: 203: FAILED assert(res.errors.empty())
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: ceph version 10.2.2 (45107e21c568dd033c2f0a3107dec8f0b0e58374)
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f4f9d6cb5b5]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 2: (OnRecoveryReadComplete::finish(std::pair<RecoveryMessages*, ECBackend::read_result_t&>&)+0x192) [0x7f4f9d26a982]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 3: (GenContext<std::pair<RecoveryMessages*, ECBackend::read_result_t&>&>::complete(std::pair<RecoveryMessages*, ECBackend::read_result_
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 4: (ECBackend::complete_read_op(ECBackend::ReadOp&, RecoveryMessages*)+0x73) [0x7f4f9d24e043]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 5: (ECBackend::handle_sub_read_reply(pg_shard_t, ECSubReadReply&, RecoveryMessages*)+0xfe9) [0x7f4f9d24f0b9]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 6: (ECBackend::handle_message(std::shared_ptr<OpRequest>)+0x1a3) [0x7f4f9d256513]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 7: (ReplicatedPG::do_request(std::shared_ptr<OpRequest>&, ThreadPool::TPHandle&)+0x100) [0x7f4f9d18b810]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 8: (OSD::dequeue_op(boost::intrusive_ptr<PG>, std::shared_ptr<OpRequest>, ThreadPool::TPHandle&)+0x41d) [0x7f4f9d040a8d]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 9: (PGQueueable::RunVis::operator()(std::shared_ptr<OpRequest>&)+0x6d) [0x7f4f9d040cdd]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x869) [0x7f4f9d045809]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x887) [0x7f4f9d6bb557]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x7f4f9d6bd4c0]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 13: (()+0x7dc5) [0x7f4f9b5f9dc5]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: 14: (clone()+0x6d) [0x7f4f99c84ced]
Jul 20 20:04:32 node4.wigen.svg ceph-osd[10258]: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.