Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- ceph version 0.61.5 (8ee10dc4bb73bdd918873f29c70eedc3c7ef1979)
- 1: (FileStore::_do_transaction(ObjectStore::Transaction&, unsigned long, int)+0x895) [0x742f15]
- 2: (FileStore::_do_transactions(std::list<ObjectStore::Transaction*, std::allocator<ObjectStore::Transaction*> >&, unsigned long, ThreadPool::TPHandle*)+0x71) [0x749141]
- 3: (JournalingObjectStore::journal_replay(unsigned long)+0x8be) [0x75a96e]
- 4: (FileStore::mount()+0x3afe) [0x73c55e]
- 5: (OSD::flushjournal(std::string const&, std::string const&)+0x1c) [0x5f6a4c]
- 6: (main()+0x917) [0x572fd7]
- 7: (__libc_start_main()+0xed) [0x7f6a0f5ca76d]
- 8: ceph-osd() [0x5770fd]
- NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- --- begin dump of recent events ---
- -48> 2013-08-06 11:32:27.968603 7f6a1198d780 5 asok(0x2dbe000) register_command perfcounters_dump hook 0x2db2010
- -47> 2013-08-06 11:32:27.968635 7f6a1198d780 5 asok(0x2dbe000) register_command 1 hook 0x2db2010
- -46> 2013-08-06 11:32:27.968663 7f6a1198d780 5 asok(0x2dbe000) register_command perf dump hook 0x2db2010
- -45> 2013-08-06 11:32:27.968676 7f6a1198d780 5 asok(0x2dbe000) register_command perfcounters_schema hook 0x2db2010
- -44> 2013-08-06 11:32:27.968683 7f6a1198d780 5 asok(0x2dbe000) register_command 2 hook 0x2db2010
- -43> 2013-08-06 11:32:27.968685 7f6a1198d780 5 asok(0x2dbe000) register_command perf schema hook 0x2db2010
- -42> 2013-08-06 11:32:27.968695 7f6a1198d780 5 asok(0x2dbe000) register_command config show hook 0x2db2010
- -41> 2013-08-06 11:32:27.968698 7f6a1198d780 5 asok(0x2dbe000) register_command config set hook 0x2db2010
- -40> 2013-08-06 11:32:27.968702 7f6a1198d780 5 asok(0x2dbe000) register_command log flush hook 0x2db2010
- -39> 2013-08-06 11:32:27.968708 7f6a1198d780 5 asok(0x2dbe000) register_command log dump hook 0x2db2010
- -38> 2013-08-06 11:32:27.968711 7f6a1198d780 5 asok(0x2dbe000) register_command log reopen hook 0x2db2010
- -37> 2013-08-06 11:32:27.970602 7f6a1198d780 0 ceph version 0.61.5 (8ee10dc4bb73bdd918873f29c70eedc3c7ef1979), process ceph-osd, pid 25323
- -36> 2013-08-06 11:32:27.973104 7f6a1198d780 5 asok(0x2dbe000) init /var/run/ceph/ceph-osd.10.asok
- -35> 2013-08-06 11:32:27.973127 7f6a1198d780 5 asok(0x2dbe000) bind_and_listen /var/run/ceph/ceph-osd.10.asok
- -34> 2013-08-06 11:32:27.973180 7f6a1198d780 5 asok(0x2dbe000) register_command 0 hook 0x2db10b0
- -33> 2013-08-06 11:32:27.973188 7f6a1198d780 5 asok(0x2dbe000) register_command version hook 0x2db10b0
- -32> 2013-08-06 11:32:27.973191 7f6a1198d780 5 asok(0x2dbe000) register_command git_version hook 0x2db10b0
- -31> 2013-08-06 11:32:27.973196 7f6a1198d780 5 asok(0x2dbe000) register_command help hook 0x2db20d0
- -30> 2013-08-06 11:32:27.973239 7f6a0d614700 5 asok(0x2dbe000) entry start
- -29> 2013-08-06 11:32:28.047141 7f6a1198d780 0 filestore(/var/lib/ceph/osd/ceph-10) mount FIEMAP ioctl is supported and appears to work
- -28> 2013-08-06 11:32:28.047155 7f6a1198d780 0 filestore(/var/lib/ceph/osd/ceph-10) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
- -27> 2013-08-06 11:32:28.047841 7f6a1198d780 0 filestore(/var/lib/ceph/osd/ceph-10) mount did NOT detect btrfs
- -26> 2013-08-06 11:32:28.109989 7f6a1198d780 0 filestore(/var/lib/ceph/osd/ceph-10) mount syncfs(2) syscall fully supported (by glibc and kernel)
- -25> 2013-08-06 11:32:28.110097 7f6a1198d780 0 filestore(/var/lib/ceph/osd/ceph-10) mount found snaps <>
- -24> 2013-08-06 11:32:28.174316 7f6a1198d780 0 filestore(/var/lib/ceph/osd/ceph-10) mount: enabling WRITEAHEAD journal mode: btrfs not detected
- -23> 2013-08-06 11:32:28.182896 7f6a1198d780 2 journal open /var/lib/ceph/osd/ceph-10/journal fsid 058b41a8-69db-4ee7-bf12-ae4a4001bc65 fs_op_seq 6080517
- -22> 2013-08-06 11:32:28.185616 7f6a1198d780 0 journal kernel version is 3.5.0
- -21> 2013-08-06 11:32:28.185857 7f6a1198d780 1 journal _open /var/lib/ceph/osd/ceph-10/journal fd 17: 1072693248 bytes, block size 4096 bytes, directio = 1, aio = 1
- -20> 2013-08-06 11:32:28.206187 7f6a1198d780 2 journal read_entry 38350848 : seq 6080504 2342994 bytes
- -19> 2013-08-06 11:32:28.229455 7f6a1198d780 2 journal read_entry 42553344 : seq 6080505 4195932 bytes
- -18> 2013-08-06 11:32:28.250732 7f6a1198d780 2 journal read_entry 46755840 : seq 6080506 4195932 bytes
- -17> 2013-08-06 11:32:28.261607 7f6a1198d780 2 journal read_entry 49029120 : seq 6080507 2268285 bytes
- -16> 2013-08-06 11:32:28.284398 7f6a1198d780 2 journal read_entry 53231616 : seq 6080508 4195932 bytes
- -15> 2013-08-06 11:32:28.284457 7f6a1198d780 2 journal read_entry 53235712 : seq 6080509 2649 bytes
- -14> 2013-08-06 11:32:28.305711 7f6a1198d780 2 journal read_entry 57438208 : seq 6080510 4195830 bytes
- -13> 2013-08-06 11:32:28.311519 7f6a1198d780 2 journal read_entry 58810368 : seq 6080511 1366054 bytes
- -12> 2013-08-06 11:32:28.335034 7f6a1198d780 2 journal read_entry 63012864 : seq 6080512 4195830 bytes
- -11> 2013-08-06 11:32:28.343611 7f6a1198d780 2 journal read_entry 65028096 : seq 6080513 2011462 bytes
- -10> 2013-08-06 11:32:28.353730 7f6a1198d780 2 journal read_entry 67063808 : seq 6080514 2028885 bytes
- -9> 2013-08-06 11:32:28.376661 7f6a1198d780 2 journal read_entry 71266304 : seq 6080515 4195932 bytes
- -8> 2013-08-06 11:32:28.398959 7f6a1198d780 2 journal read_entry 75468800 : seq 6080516 4195830 bytes
- -7> 2013-08-06 11:32:28.407703 7f6a1198d780 2 journal read_entry 77516800 : seq 6080517 2041410 bytes
- -6> 2013-08-06 11:32:28.407744 7f6a1198d780 2 journal read_entry 77520896 : seq 6080518 1372 bytes
- -5> 2013-08-06 11:32:28.407758 7f6a1198d780 2 journal read_entry 77520896 : seq 6080518 1372 bytes
- -4> 2013-08-06 11:32:28.407768 7f6a1198d780 3 journal journal_replay: applying op seq 6080518
- -3> 2013-08-06 11:32:28.409083 7f6a1198d780 0 filestore(/var/lib/ceph/osd/ceph-10) error (39) Directory not empty not handled on operation 21 (6080518.0.15, or op 15, counting from 0)
- -2> 2013-08-06 11:32:28.409116 7f6a1198d780 0 filestore(/var/lib/ceph/osd/ceph-10) ENOTEMPTY suggests garbage data in osd data dir
- -1> 2013-08-06 11:32:28.409118 7f6a1198d780 0 filestore(/var/lib/ceph/osd/ceph-10) transaction dump:
- { "ops": [
- { "op_num": 0,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "554af6d2\/100001f1db0.00000000\/head\/\/3"},
- { "op_num": 1,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "b8daf6d2\/1000007a6db.00000000\/head\/\/3"},
- { "op_num": 2,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "d5faf6d2\/10000186138.00000002\/head\/\/3"},
- { "op_num": 3,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "d8bf6d2\/1000002d26c.00000009\/head\/\/3"},
- { "op_num": 4,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "6dcbf6d2\/100001d713a.00000000\/head\/\/3"},
- { "op_num": 5,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "80dbf6d2\/100001af2f2.00000005\/head\/\/3"},
- { "op_num": 6,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "2dfbf6d2\/100000d7ae0.00000000\/head\/\/3"},
- { "op_num": 7,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "2a9cf6d2\/1000005e64d.00000000\/head\/\/3"},
- { "op_num": 8,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "870df6d2\/1000002d9a2.00000002\/head\/\/3"},
- { "op_num": 9,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "7d5df6d2\/100001e3143.00000000\/head\/\/3"},
- { "op_num": 10,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "618ef6d2\/1000004bd0a.00000000\/head\/\/3"},
- { "op_num": 11,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "7eaef6d2\/100000a77a7.00000005\/head\/\/3"},
- { "op_num": 12,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "fd7ff6d2\/10000011b2c.00000001\/head\/\/3"},
- { "op_num": 13,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "e1eff6d2\/100000b5a21.00000000\/head\/\/3"},
- { "op_num": 14,
- "op_name": "remove",
- "collection": "FORREMOVAL_31_3.6d2",
- "oid": "e2eff6d2\/1000012e8d5.00000000\/head\/\/3"},
- { "op_num": 15,
- "op_name": "rmcoll",
- "collection": "FORREMOVAL_31_3.6d2"}]}
- 0> 2013-08-06 11:32:28.410753 7f6a1198d780 -1 os/FileStore.cc: In function 'unsigned int FileStore::_do_transaction(ObjectStore::Transaction&, uint64_t, int)' thread 7f6a1198d780 time 2013-08-06 11:32:28.409267
- os/FileStore.cc: 2698: FAILED assert(0 == "unexpected error")
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement