Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- jenkins@host-44-0-2-109:~> rados cppool data data_cp2
- terminate called after throwing an instance of 'std::runtime_error'
- what(): rados returned (22) Invalid argument
- *** Caught signal (Aborted) **
- in thread 7f973ed80780
- ceph version ()
- 1: rados() [0x4ef62a]
- 2: (()+0xf890) [0x7f973c1f3890]
- 3: (gsignal()+0x37) [0x7f973aae2187]
- 4: (abort()+0x118) [0x7f973aae3538]
- 5: (__gnu_cxx::__verbose_terminate_handler()+0x155) [0x7f973b3d2145]
- 6: (()+0x632e6) [0x7f973b3d02e6]
- 7: (()+0x63313) [0x7f973b3d0313]
- 8: (()+0x63532) [0x7f973b3d0532]
- 9: (()+0x4ee66) [0x7f973c667e66]
- 10: (librados::IoCtx::nobjects_begin()+0x2e) [0x7f973c66e36e]
- 11: (main()+0x85b7) [0x4c7d37]
- 12: (__libc_start_main()+0xf5) [0x7f973aaceb05]
- 13: rados() [0x4cd437]
- 2015-04-07 14:57:41.137203 7f973ed80780 -1 *** Caught signal (Aborted) **
- in thread 7f973ed80780
- ceph version ()
- 1: rados() [0x4ef62a]
- 2: (()+0xf890) [0x7f973c1f3890]
- 3: (gsignal()+0x37) [0x7f973aae2187]
- 4: (abort()+0x118) [0x7f973aae3538]
- 5: (__gnu_cxx::__verbose_terminate_handler()+0x155) [0x7f973b3d2145]
- 6: (()+0x632e6) [0x7f973b3d02e6]
- 7: (()+0x63313) [0x7f973b3d0313]
- 8: (()+0x63532) [0x7f973b3d0532]
- 9: (()+0x4ee66) [0x7f973c667e66]
- 10: (librados::IoCtx::nobjects_begin()+0x2e) [0x7f973c66e36e]
- 11: (main()+0x85b7) [0x4c7d37]
- 12: (__libc_start_main()+0xf5) [0x7f973aaceb05]
- 13: rados() [0x4cd437]
- NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- --- begin dump of recent events ---
- -71> 2015-04-07 14:57:41.109019 7f973ed80780 5 asok(0x28bfb90) register_command perfcounters_dump hook 0x28c1cd0
- -70> 2015-04-07 14:57:41.109051 7f973ed80780 5 asok(0x28bfb90) register_command 1 hook 0x28c1cd0
- -69> 2015-04-07 14:57:41.109056 7f973ed80780 5 asok(0x28bfb90) register_command perf dump hook 0x28c1cd0
- -68> 2015-04-07 14:57:41.109062 7f973ed80780 5 asok(0x28bfb90) register_command perfcounters_schema hook 0x28c1cd0
- -67> 2015-04-07 14:57:41.109066 7f973ed80780 5 asok(0x28bfb90) register_command 2 hook 0x28c1cd0
- -66> 2015-04-07 14:57:41.109070 7f973ed80780 5 asok(0x28bfb90) register_command perf schema hook 0x28c1cd0
- -65> 2015-04-07 14:57:41.109073 7f973ed80780 5 asok(0x28bfb90) register_command perf reset hook 0x28c1cd0
- -64> 2015-04-07 14:57:41.109080 7f973ed80780 5 asok(0x28bfb90) register_command config show hook 0x28c1cd0
- -63> 2015-04-07 14:57:41.109084 7f973ed80780 5 asok(0x28bfb90) register_command config set hook 0x28c1cd0
- -62> 2015-04-07 14:57:41.109088 7f973ed80780 5 asok(0x28bfb90) register_command config get hook 0x28c1cd0
- -61> 2015-04-07 14:57:41.109091 7f973ed80780 5 asok(0x28bfb90) register_command config diff hook 0x28c1cd0
- -60> 2015-04-07 14:57:41.109094 7f973ed80780 5 asok(0x28bfb90) register_command log flush hook 0x28c1cd0
- -59> 2015-04-07 14:57:41.109097 7f973ed80780 5 asok(0x28bfb90) register_command log dump hook 0x28c1cd0
- -58> 2015-04-07 14:57:41.109101 7f973ed80780 5 asok(0x28bfb90) register_command log reopen hook 0x28c1cd0
- -57> 2015-04-07 14:57:41.116034 7f973ed80780 10 monclient(hunting): build_initial_monmap
- -56> 2015-04-07 14:57:41.116198 7f973ed80780 1 librados: starting msgr at :/0
- -55> 2015-04-07 14:57:41.116229 7f973ed80780 1 librados: starting objecter
- -54> 2015-04-07 14:57:41.116288 7f973ed80780 5 asok(0x28bfb90) register_command objecter_requests hook 0x28dc2a0
- -53> 2015-04-07 14:57:41.116415 7f973ed80780 1 -- :/0 messenger.start
- -52> 2015-04-07 14:57:41.116462 7f973ed80780 1 librados: setting wanted keys
- -51> 2015-04-07 14:57:41.116476 7f973ed80780 1 librados: calling monclient init
- -50> 2015-04-07 14:57:41.116485 7f973ed80780 10 monclient(hunting): init
- -49> 2015-04-07 14:57:41.116506 7f973ed80780 5 adding auth protocol: cephx
- -48> 2015-04-07 14:57:41.116521 7f973ed80780 10 monclient(hunting): auth_supported 2 method cephx
- -47> 2015-04-07 14:57:41.116822 7f973ed80780 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.client.admin.keyring
- -46> 2015-04-07 14:57:41.116953 7f973ed80780 10 monclient(hunting): _reopen_session rank -1 name
- -45> 2015-04-07 14:57:41.117033 7f973ed80780 10 monclient(hunting): picked mon.noname-c con 0x28e20e0 addr 44.0.2.112:6789/0
- -44> 2015-04-07 14:57:41.117094 7f973ed80780 10 monclient(hunting): _send_mon_message to mon.noname-c at 44.0.2.112:6789/0
- -43> 2015-04-07 14:57:41.117111 7f973ed80780 1 -- :/1023525 --> 44.0.2.112:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- ?+0 0x28e48c0 con 0x28e20e0
- -42> 2015-04-07 14:57:41.117144 7f973ed80780 10 monclient(hunting): renew_subs
- -41> 2015-04-07 14:57:41.117160 7f973ed80780 10 monclient(hunting): authenticate will time out at 2015-04-07 15:02:41.117159
- -40> 2015-04-07 14:57:41.119018 7f973ed7e700 1 -- 44.0.2.109:0/1023525 learned my addr 44.0.2.109:0/1023525
- -39> 2015-04-07 14:57:41.120769 7f97380d4700 1 -- 44.0.2.109:0/1023525 <== mon.2 44.0.2.112:6789/0 1 ==== mon_map magic: 0 v1 ==== 515+0+0 (3380379738 0 0) 0x7f9728000bf0 con 0x28e20e0
- -38> 2015-04-07 14:57:41.120820 7f97380d4700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
- -37> 2015-04-07 14:57:41.120835 7f97380d4700 10 monclient(hunting): got monmap 1, mon.noname-c is now rank -1
- -36> 2015-04-07 14:57:41.120841 7f97380d4700 10 monclient(hunting): dump:
- epoch 1
- fsid af6b0b43-0480-4691-b10a-6039dceea3d8
- last_changed 0.000000
- created 0.000000
- 0: 44.0.2.109:6789/0 mon.host-44-0-2-109
- 1: 44.0.2.111:6789/0 mon.host-44-0-2-111
- 2: 44.0.2.112:6789/0 mon.host-44-0-2-112
- -35> 2015-04-07 14:57:41.120897 7f97380d4700 1 -- 44.0.2.109:0/1023525 <== mon.2 44.0.2.112:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3620486161 0 0) 0x7f97280008c0 con 0x28e20e0
- -34> 2015-04-07 14:57:41.120938 7f97380d4700 10 monclient(hunting): my global_id is 4247
- -33> 2015-04-07 14:57:41.121156 7f97380d4700 10 monclient(hunting): _send_mon_message to mon.host-44-0-2-112 at 44.0.2.112:6789/0
- -32> 2015-04-07 14:57:41.121164 7f97380d4700 1 -- 44.0.2.109:0/1023525 --> 44.0.2.112:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- ?+0 0x7f972c0015c0 con 0x28e20e0
- -31> 2015-04-07 14:57:41.122810 7f97380d4700 1 -- 44.0.2.109:0/1023525 <== mon.2 44.0.2.112:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (55340898 0 0) 0x7f97280008c0 con 0x28e20e0
- -30> 2015-04-07 14:57:41.123346 7f97380d4700 10 monclient(hunting): _send_mon_message to mon.host-44-0-2-112 at 44.0.2.112:6789/0
- -29> 2015-04-07 14:57:41.123367 7f97380d4700 1 -- 44.0.2.109:0/1023525 --> 44.0.2.112:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- ?+0 0x7f972c002080 con 0x28e20e0
- -28> 2015-04-07 14:57:41.125040 7f97380d4700 1 -- 44.0.2.109:0/1023525 <== mon.2 44.0.2.112:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 393+0+0 (4014029383 0 0) 0x7f9728001150 con 0x28e20e0
- -27> 2015-04-07 14:57:41.125328 7f97380d4700 1 monclient(hunting): found mon.host-44-0-2-112
- -26> 2015-04-07 14:57:41.125337 7f97380d4700 10 monclient: _send_mon_message to mon.host-44-0-2-112 at 44.0.2.112:6789/0
- -25> 2015-04-07 14:57:41.125348 7f97380d4700 1 -- 44.0.2.109:0/1023525 --> 44.0.2.112:6789/0 -- mon_subscribe({monmap=0+}) v2 -- ?+0 0x28e4d40 con 0x28e20e0
- -24> 2015-04-07 14:57:41.125452 7f973ed80780 5 monclient: authenticate success, global_id 4247
- -23> 2015-04-07 14:57:41.125523 7f973ed80780 10 monclient: renew_subs
- -22> 2015-04-07 14:57:41.125531 7f973ed80780 10 monclient: _send_mon_message to mon.host-44-0-2-112 at 44.0.2.112:6789/0
- -21> 2015-04-07 14:57:41.125541 7f973ed80780 1 -- 44.0.2.109:0/1023525 --> 44.0.2.112:6789/0 -- mon_subscribe({monmap=2+,osdmap=0}) v2 -- ?+0 0x28e48c0 con 0x28e20e0
- -20> 2015-04-07 14:57:41.125669 7f973ed80780 10 monclient: renew_subs
- -19> 2015-04-07 14:57:41.125679 7f973ed80780 10 monclient: _send_mon_message to mon.host-44-0-2-112 at 44.0.2.112:6789/0
- -18> 2015-04-07 14:57:41.125688 7f973ed80780 1 -- 44.0.2.109:0/1023525 --> 44.0.2.112:6789/0 -- mon_subscribe({monmap=2+,osdmap=0}) v2 -- ?+0 0x28e2470 con 0x28e20e0
- -17> 2015-04-07 14:57:41.125761 7f973ed80780 1 librados: init done
- -16> 2015-04-07 14:57:41.128044 7f97380d4700 1 -- 44.0.2.109:0/1023525 <== mon.2 44.0.2.112:6789/0 5 ==== mon_map magic: 0 v1 ==== 515+0+0 (3380379738 0 0) 0x7f9728001150 con 0x28e20e0
- -15> 2015-04-07 14:57:41.128187 7f97380d4700 10 monclient: handle_monmap mon_map magic: 0 v1
- -14> 2015-04-07 14:57:41.128258 7f97380d4700 10 monclient: got monmap 1, mon.host-44-0-2-112 is now rank 2
- -13> 2015-04-07 14:57:41.128265 7f97380d4700 10 monclient: dump:
- epoch 1
- fsid af6b0b43-0480-4691-b10a-6039dceea3d8
- last_changed 0.000000
- created 0.000000
- 0: 44.0.2.109:6789/0 mon.host-44-0-2-109
- 1: 44.0.2.111:6789/0 mon.host-44-0-2-111
- 2: 44.0.2.112:6789/0 mon.host-44-0-2-112
- -12> 2015-04-07 14:57:41.128381 7f97380d4700 1 -- 44.0.2.109:0/1023525 <== mon.2 44.0.2.112:6789/0 6 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (277974195 0 0) 0x7f9728001560 con 0x28e20e0
- -11> 2015-04-07 14:57:41.128410 7f97380d4700 10 monclient: handle_subscribe_ack sent 2015-04-07 14:57:41.117153 renew after 2015-04-07 15:00:11.117153
- -10> 2015-04-07 14:57:41.128455 7f97380d4700 1 -- 44.0.2.109:0/1023525 <== mon.2 44.0.2.112:6789/0 7 ==== osd_map(335..335 src has 1..335) v3 ==== 10152+0+0 (3967472173 0 0) 0x7f97280040d0 con 0x28e20e0
- -9> 2015-04-07 14:57:41.129399 7f973ed80780 1 -- 44.0.2.109:0/1023525 --> 44.0.2.109:6800/22619 -- osd_op(client.4247.0:1 / [pgnls start_epoch 0] 0.0 ack+read+known_if_redirected e335) v5 -- ?+0 0x28f07a0 con 0x28ef430
- -8> 2015-04-07 14:57:41.129727 7f97380d4700 1 -- 44.0.2.109:0/1023525 <== mon.2 44.0.2.112:6789/0 8 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (277974195 0 0) 0x7f9728001560 con 0x28e20e0
- -7> 2015-04-07 14:57:41.129777 7f97380d4700 10 monclient: handle_subscribe_ack sent 0.000000, ignoring
- -6> 2015-04-07 14:57:41.129792 7f97380d4700 1 -- 44.0.2.109:0/1023525 <== mon.2 44.0.2.112:6789/0 9 ==== osd_map(335..335 src has 1..335) v3 ==== 10152+0+0 (3967472173 0 0) 0x7f97280040d0 con 0x28e20e0
- -5> 2015-04-07 14:57:41.129827 7f97380d4700 1 -- 44.0.2.109:0/1023525 <== mon.2 44.0.2.112:6789/0 10 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (277974195 0 0) 0x7f97280009b0 con 0x28e20e0
- -4> 2015-04-07 14:57:41.129845 7f97380d4700 10 monclient: handle_subscribe_ack sent 0.000000, ignoring
- -3> 2015-04-07 14:57:41.132185 7f97346cb700 1 -- 44.0.2.109:0/1023525 <== osd.0 44.0.2.109:6800/22619 1 ==== osd_op_reply(1 [pgnls start_epoch 0] v0'0 uv0 ondisk = 1) v6 ==== 167+0+49 (1250995021 0 3669706305) 0x7f9724000c20 con 0x28ef430
- -2> 2015-04-07 14:57:41.132335 7f97346cb700 1 -- 44.0.2.109:0/1023525 --> 44.0.2.111:6800/7590 -- osd_op(client.4247.0:2 / [pgnls start_epoch 0] 0.1 ack+read+known_if_redirected e335) v5 -- ?+0 0x7f9724008cc0 con 0x7f9724007950
- -1> 2015-04-07 14:57:41.135689 7f97344c9700 1 -- 44.0.2.109:0/1023525 <== osd.1 44.0.2.111:6800/7590 1 ==== osd_op_reply(2 [pgnls start_epoch 0] v0'0 uv0 ondisk = -22 ((22) Invalid argument)) v6 ==== 167+0+0 (1661311677 0 0) 0x7f971c000a90 con 0x7f9724007950
- 0> 2015-04-07 14:57:41.137203 7f973ed80780 -1 *** Caught signal (Aborted) **
- in thread 7f973ed80780
- ceph version ()
- 1: rados() [0x4ef62a]
- 2: (()+0xf890) [0x7f973c1f3890]
- 3: (gsignal()+0x37) [0x7f973aae2187]
- 4: (abort()+0x118) [0x7f973aae3538]
- 5: (__gnu_cxx::__verbose_terminate_handler()+0x155) [0x7f973b3d2145]
- 6: (()+0x632e6) [0x7f973b3d02e6]
- 7: (()+0x63313) [0x7f973b3d0313]
- 8: (()+0x63532) [0x7f973b3d0532]
- 9: (()+0x4ee66) [0x7f973c667e66]
- 10: (librados::IoCtx::nobjects_begin()+0x2e) [0x7f973c66e36e]
- 11: (main()+0x85b7) [0x4c7d37]
- 12: (__libc_start_main()+0xf5) [0x7f973aaceb05]
- 13: rados() [0x4cd437]
- NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- --- logging levels ---
- 0/ 5 none
- 0/ 1 lockdep
- 0/ 1 context
- 1/ 1 crush
- 1/ 5 mds
- 1/ 5 mds_balancer
- 1/ 5 mds_locker
- 1/ 5 mds_log
- 1/ 5 mds_log_expire
- 1/ 5 mds_migrator
- 0/ 1 buffer
- 0/ 1 timer
- 0/ 1 filer
- 0/ 1 striper
- 0/ 1 objecter
- 0/ 5 rados
- 0/ 5 rbd
- 0/ 5 rbd_replay
- 0/ 5 journaler
- 0/ 5 objectcacher
- 0/ 5 client
- 0/ 5 osd
- 0/ 5 optracker
- 0/ 5 objclass
- 1/ 3 filestore
- 1/ 3 keyvaluestore
- 1/ 3 journal
- 0/ 5 ms
- 1/ 5 mon
- 0/10 monc
- 1/ 5 paxos
- 0/ 5 tp
- 1/ 5 auth
- 1/ 5 crypto
- 1/ 1 finisher
- 1/ 5 heartbeatmap
- 1/ 5 perfcounter
- 1/ 5 rgw
- 1/10 civetweb
- 1/ 5 javaclient
- 1/ 5 asok
- 1/ 1 throttle
- 0/ 0 refs
- 1/ 5 xio
- -2/-2 (syslog threshold)
- 99/99 (stderr threshold)
- max_recent 500
- max_new 1000
- log_file
- --- end dump of recent events ---
- Aborted
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement