2011-04-08 19:02:44.099544 7f122cae6710 -- 192.168.98.110:6811/2712 >> 192.168.98.111:6811/2414 pipe(0x7f12301a7530 sd=30 pgs=0 cs=0 l=0).connect claims to be 0.0.0.0:6811/2034 not 192.168.98.111:6811/2414 - wrong node!
2011-04-08 19:02:44.521459 7f122c9e5710 -- 192.168.98.110:6812/2712 >> 192.168.98.111:6812/2414 pipe(0x7f12301ad4b0 sd=28 pgs=0 cs=0 l=0).connect claims to be 0.0.0.0:6812/2034 not 192.168.98.111:6812/2414 - wrong node!
2011-04-08 19:02:45.794519 7f122c9e5710 -- 192.168.98.110:6811/2712 >> 192.168.98.111:6811/2034 pipe(0x7f1230213880 sd=28 pgs=0 cs=0 l=0).connect claims to be 0.0.0.0:6811/2034 not 192.168.98.111:6811/2034 - presumably this is the same node!
2011-04-08 19:02:45.802331 7f122cae6710 -- 192.168.98.110:6812/2712 >> 192.168.98.111:6812/2034 pipe(0x7f12301c5570 sd=30 pgs=0 cs=0 l=0).connect claims to be 0.0.0.0:6812/2034 not 192.168.98.111:6812/2034 - presumably this is the same node!
2011-04-08 19:02:48.485643 7f123cf45710 osd7 59 pg[1.1f0( v 9'1 (0'0,9'1] n=1 ec=2 les=55 53/53/52) [7,8] r=0 lcod 0'0 mlcod 0'0 active+clean+replay] oi.user_version=0'0 is_modify=0
2011-04-08 19:02:48.485735 7f123cf45710 log [ERR] : 1.1f0 200.00000022/head oi.size 0 but stat got -2 size 0
osd/ReplicatedPG.cc: In function 'int ReplicatedPG::do_osd_ops(ReplicatedPG::OpContext*, std::vector<OSDOp, std::allocator<OSDOp> >&, ceph::bufferlist&)', in thread '0x7f123cf45710'
osd/ReplicatedPG.cc: 1211: FAILED assert(0 == "oi disagrees with stat")
 ceph version 0.24.2-1487-g24caedc (commit:24caedc8f549eeeba48b2d4a44927ee16e65c42a)
 1: (ReplicatedPG::do_osd_ops(ReplicatedPG::OpContext*, std::vector<OSDOp, std::allocator<OSDOp> >&, ceph::buffer::list&)+0xa2d0) [0x4b4be0]
 2: (ReplicatedPG::prepare_transaction(ReplicatedPG::OpContext*)+0x6f) [0x4b54cf]
 3: (ReplicatedPG::do_op(MOSDOp*)+0xa12) [0x4b6be2]
 4: (OSD::dequeue_op(PG*)+0x34d) [0x501f3d]
 5: (ThreadPool::worker()+0x519) [0x5f9f19]
 6: (ThreadPool::WorkThread::entry()+0xd) [0x51a12d]
 7: (()+0x77e1) [0x7f1249a537e1]
 8: (clone()+0x6d) [0x7f124893f51d]
 ceph version 0.24.2-1487-g24caedc (commit:24caedc8f549eeeba48b2d4a44927ee16e65c42a)
 1: (ReplicatedPG::do_osd_ops(ReplicatedPG::OpContext*, std::vector<OSDOp, std::allocator<OSDOp> >&, ceph::buffer::list&)+0xa2d0) [0x4b4be0]
 2: (ReplicatedPG::prepare_transaction(ReplicatedPG::OpContext*)+0x6f) [0x4b54cf]
 3: (ReplicatedPG::do_op(MOSDOp*)+0xa12) [0x4b6be2]
 4: (OSD::dequeue_op(PG*)+0x34d) [0x501f3d]
 5: (ThreadPool::worker()+0x519) [0x5f9f19]
 6: (ThreadPool::WorkThread::entry()+0xd) [0x51a12d]
 7: (()+0x77e1) [0x7f1249a537e1]
 8: (clone()+0x6d) [0x7f124893f51d]
*** Caught signal (Aborted) **
 in thread 0x7f123cf45710
 ceph version 0.24.2-1487-g24caedc (commit:24caedc8f549eeeba48b2d4a44927ee16e65c42a)
 1: /usr/bin/cosd() [0x60fb92]
 2: (()+0xf4c0) [0x7f1249a5b4c0]
 3: (gsignal()+0x35) [0x7f12488909b5]
 4: (abort()+0x175) [0x7f1248892195]
 5: (__gnu_cxx::__verbose_terminate_handler()+0x12d) [0x7f1249135aad]
 6: (()+0xbcc36) [0x7f1249133c36]
 7: (()+0xbcc63) [0x7f1249133c63]
 8: (()+0xbcd5e) [0x7f1249133d5e]
 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x373) [0x5f7163]
 10: (ReplicatedPG::do_osd_ops(ReplicatedPG::OpContext*, std::vector<OSDOp, std::allocator<OSDOp> >&, ceph::buffer::list&)+0xa2d0) [0x4b4be0]
 11: (ReplicatedPG::prepare_transaction(ReplicatedPG::OpContext*)+0x6f) [0x4b54cf]
 12: (ReplicatedPG::do_op(MOSDOp*)+0xa12) [0x4b6be2]
 13: (OSD::dequeue_op(PG*)+0x34d) [0x501f3d]
 14: (ThreadPool::worker()+0x519) [0x5f9f19]
 15: (ThreadPool::WorkThread::entry()+0xd) [0x51a12d]
 16: (()+0x77e1) [0x7f1249a537e1]
 17: (clone()+0x6d) [0x7f124893f51d]