2012-06-19 09:09:56.398750 7f9271482700 20 mon.a@0(leader) e1 have connection
2012-06-19 09:09:56.398755 7f9271482700 20 epoch        49
flags   0
created mon.a@0(leader) e1 ms_dispatch existing session MonSession: client.? 127.0.0.1:0/7355 is openallow * for client.? 127.0.0.1:0/7355
2012-06-19 09:09:56.398768 7f9271482700 20 mon.a@0(leader) e1  caps allow *
2012-06-19 09:09:56.398772 7f9271482700 10 mon.a@0(leader) e1 handle_subscribe mon_subscribe({monmap=2+}) v2
2012-06-19 09:09:56.398768 7f92768ad700 10 -- 127.0.0.1:6789/0 >> 127.0.0.1:0/7355 pipe(0x7f9260002150 sd=10 pgs=3432 cs=1 l=1).aborted = 0
2012-06-19 09:09:56.398780 7f9271482700 10 mon.a@0(leader) e1 check_sub monmap next 2 have 1
2012-06-19 09:09:56.398786 7f92768ad700 10 -- 127.0.0.1:6789/0 >> 127.0.0.1:0/7355 pipe(0x7f9260002150 sd=10 pgs=3432 cs=1 l=1).reader got message 4 0x7f9248004690 mon_command(status v 0) v1
2012-06-19 09:09:56.398786 7f9271482700  1 -- 127.0.0.1:6789/0 --> client.? 127.0.0.1:0/7355 -- mon_subscribe_ack(300s) v1 -- ?+0 0x7f9254039c70
2012-06-14 08:42:54.6279482012-06-19 09:09:56.398803 7f9271482700 10
-- 127.0.0.1:6789/0 dispatch_throttle_release 23 to dispatch throttler 71/104857600
127.0.0.1:6789/0 <== client.? 127.0.0.1:0/7355 4 ==== mon_command(status v 0) v1 ==== 48+0+0 (1288768350 0 0) 0x7f9248004690 con 0x7f92600023c0
modified        2012-06-19 08:35:25.614937
tableserver     0
root    0
session_timeout 60
session_autoclose       300
last_failure    0
last_failure_osd_epoch  16
2012-06-19 09:09:56.398814 7f9271482700  1 compat       compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object}
max_mds 3
in      0,1,2--
up      {0=4803,1=4397,2=4701}
failed
stopped
data_pools      [0]
metadata_pool   1
2012-06-19 09:09:56.398829 7f9271482700 20 mon.a@0(leader) e1 have connection
2012-06-19 09:09:56.398832 7f9271482700 20 mon.a@0(leader) e1 ms_dispatch existing session MonSession: client.? 127.0.0.1:0/7355 is openallow * for client.? 127.0.0.1:0/7355
2012-06-19 09:09:56.398843 7f9271482700 20 mon.a@0(leader) e1  caps allow *
2012-06-19 09:09:56.398855 7f9271482700  0 mon.a@0(leader) e1 handle_command mon_command(status v 0) v1
2012-06-19 09:09:56.398977 7f927037f700 10 -- 127.0.0.1:6789/0 >> 127.0.0.1:0/7355 pipe(0x7f9260002150 sd=10 pgs=3432 cs=1 l=1).writer: state = 2 policy.server=1
2012-06-19 09:09:56.398995 7f927037f700 10 -- 127.0.0.1:6789/0 >> 127.0.0.1:0/7355 pipe(0x7f9260002150 sd=10 pgs=3432 cs=1 l=1).write_ack 4
2012-06-19 09:09:56.399061 7f927037f700 10 -- 127.0.0.1:6789/0 >> 127.0.0.1:0/7355 pipe(0x7f9260002150 sd=10 pgs=3432 cs=1 l=1).writer: state = 2 policy.server=1
mds/MDSMap.cc: In function 'void MDSMap::get_health(std::list<std::pair<health_status_t, std::basic_string<char> > >&, std::list<std::pair<health_status_t, std::basic_string<char> > >*) const' thread 7f9271482700 time 2012-06-19 09:09:56.399299
mds/MDSMap.cc: 254: FAILED assert(m != m_end)
 ceph version c36f301faf59ce560059a8039eaad58f083f53e (commit:8c36f301faf59ce560059a8039eaad58f083f53e)
 1: (MDSMap::get_health(std::list<std::pair<health_status_t, std::string>, std::allocator<std::pair<health_status_t, std::string> > >&, std::list<std::pair<health_status_t, std::string>, std::allocator<std::pair<health_status_t, std::string> > >*) const+0x141f) [0x5912bf]
 2: (Monitor::get_health(std::string&, ceph::buffer::list*)+0x76) [0x4818b6]
 3: (Monitor::handle_command(MMonCommand*)+0x936) [0x4831d6]
 4: (Monitor::_ms_dispatch(Message*)+0x106b) [0x49156b]
 5: (Monitor::ms_dispatch(Message*)+0x32) [0x4a03c2]
 6: (SimpleMessenger::dispatch_entry()+0x863) [0x5f6dc3]
 7: (SimpleMessenger::DispatchThread::entry()+0xd) [0x5c900d]
 8: (()+0x7e9a) [0x7f9276558e9a]
 9: (clone()+0x6d) [0x7f9274f7e4bd]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2012-06-19 09:09:56.400566 7f9271482700 -1 mds/MDSMap.cc: In function 'void MDSMap::get_health(std::list<std::pair<health_status_t, std::basic_string<char> > >&, std::list<std::pair<health_status_t, std::basic_string<char> > >*) const' thread 7f9271482700 time 2012-06-19 09:09:56.399299
mds/MDSMap.cc: 254: FAILED assert(m != m_end)

 ceph version c36f301faf59ce560059a8039eaad58f083f53e (commit:8c36f301faf59ce560059a8039eaad58f083f53e)

 1: (MDSMap::get_health(std::list<std::pair<health_status_t, std::string>, std::allocator<std::pair<health_status_t, std::string> > >&, std::list<std::pair<health_status_t, std::string>, std::allocator<std::pair<health_status_t, std::string> > >*) const+0x141f) [0x5912bf]
 2: (Monitor::get_health(std::string&, ceph::buffer::list*)+0x76) [0x4818b6]
 3: (Monitor::handle_command(MMonCommand*)+0x936) [0x4831d6]
 4: (Monitor::_ms_dispatch(Message*)+0x106b) [0x49156b]
 5: (Monitor::ms_dispatch(Message*)+0x32) [0x4a03c2]
 6: (SimpleMessenger::dispatch_entry()+0x863) [0x5f6dc3]
 7: (SimpleMessenger::DispatchThread::entry()+0xd) [0x5c900d]
 8: (()+0x7e9a) [0x7f9276558e9a]
 9: (clone()+0x6d) [0x7f9274f7e4bd]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2012-06-19 09:09:56.400566 7f9271482700 -1 mds/MDSMap.cc: In function 'void MDSMap::get_health(std::list<std::pair<health_status_t, std::basic_string<char> > >&, std::list<std::pair<health_status_t, std::basic_string<char> > >*) const' thread 7f9271482700 time 2012-06-19 09:09:56.399299
mds/MDSMap.cc: 254: FAILED assert(m != m_end)

 ceph version c36f301faf59ce560059a8039eaad58f083f53e (commit:8c36f301faf59ce560059a8039eaad58f083f53e)
 1: (MDSMap::get_health(std::list<std::pair<health_status_t, std::string>, std::allocator<std::pair<health_status_t, std::string> > >&, std::list<std::pair<health_status_t, std::string>, std::allocator<std::pair<health_status_t, std::string> > >*) const+0x141f) [0x5912bf]
 2: (Monitor::get_health(std::string&, ceph::buffer::list*)+0x76) [0x4818b6]
 3: (Monitor::handle_command(MMonCommand*)+0x936) [0x4831d6]
 4: (Monitor::_ms_dispatch(Message*)+0x106b) [0x49156b]
 5: (Monitor::ms_dispatch(Message*)+0x32) [0x4a03c2]
 6: (SimpleMessenger::dispatch_entry()+0x863) [0x5f6dc3]
 7: (SimpleMessenger::DispatchThread::entry()+0xd) [0x5c900d]
 8: (()+0x7e9a) [0x7f9276558e9a]
 9: (clone()+0x6d) [0x7f9274f7e4bd]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.