GOOD:

2014-07-10 22:22:14.783023 7fef4cb907c0  0 ceph version 0.67.8 (ffc58b4ea6a3ea10e91050aaa28d14d87dea5656), process ceph-osd, pid 32411
2014-07-10 22:22:14.787761 7fef4cb907c0  1 filestore(/var/lib/ceph/osd/ceph-58) mount detected xfs
2014-07-10 22:22:14.787775 7fef4cb907c0  1 filestore(/var/lib/ceph/osd/ceph-58)  disabling 'filestore replica fadvise' due to known issues with fadvis
e(DONTNEED) on xfs
2014-07-10 22:22:14.790126 7fef4cb907c0  0 filestore(/var/lib/ceph/osd/ceph-58) mount FIEMAP ioctl is supported and appears to work
2014-07-10 22:22:14.790157 7fef4cb907c0  0 filestore(/var/lib/ceph/osd/ceph-58) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
2014-07-10 22:22:14.790465 7fef4cb907c0  0 filestore(/var/lib/ceph/osd/ceph-58) mount did NOT detect btrfs
2014-07-10 22:22:14.791774 7fef4cb907c0  0 filestore(/var/lib/ceph/osd/ceph-58) mount syncfs(2) syscall fully supported (by glibc and kernel)
2014-07-10 22:22:14.791941 7fef4cb907c0  0 filestore(/var/lib/ceph/osd/ceph-58) mount found snaps <>
2014-07-10 22:22:14.850317 7fef4cb907c0  0 filestore(/var/lib/ceph/osd/ceph-58) mount: enabling WRITEAHEAD journal mode: btrfs not detected
2014-07-10 22:22:14.877252 7fef4cb907c0 -1 journal FileJournal::_open: disabling aio for non-block journal.  Use journal_force_aio to force use of aio anyway
2014-07-10 22:22:14.877299 7fef4cb907c0  1 journal _open /var/lib/ceph/osd/ceph-58/journal fd 19: 2147483648 bytes, block size 4096 bytes, directio = 1, aio = 0
2014-07-10 22:22:14.877903 7fef4cb907c0  1 journal _open /var/lib/ceph/osd/ceph-58/journal fd 19: 2147483648 bytes, block size 4096 bytes, directio = 1, aio = 0
2014-07-10 22:22:14.878716 7fef4cb907c0  1 journal close /var/lib/ceph/osd/ceph-58/journal
2014-07-10 22:22:14.880248 7fef4cb907c0  1 filestore(/var/lib/ceph/osd/ceph-58) mount detected xfs
2014-07-10 22:22:14.882397 7fef4cb907c0  0 filestore(/var/lib/ceph/osd/ceph-58) mount FIEMAP ioctl is supported and appears to work
2014-07-10 22:22:14.882422 7fef4cb907c0  0 filestore(/var/lib/ceph/osd/ceph-58) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
2014-07-10 22:22:14.882753 7fef4cb907c0  0 filestore(/var/lib/ceph/osd/ceph-58) mount did NOT detect btrfs
2014-07-10 22:22:14.884170 7fef4cb907c0  0 filestore(/var/lib/ceph/osd/ceph-58) mount syncfs(2) syscall fully supported (by glibc and kernel)
2014-07-10 22:22:14.884285 7fef4cb907c0  0 filestore(/var/lib/ceph/osd/ceph-58) mount found snaps <>
2014-07-10 22:22:14.886676 7fef4cb907c0  0 filestore(/var/lib/ceph/osd/ceph-58) mount: enabling WRITEAHEAD journal mode: btrfs not detected
2014-07-10 22:22:14.903668 7fef4cb907c0 -1 journal FileJournal::_open: disabling aio for non-block journal.  Use journal_force_aio to force use of aio anyway
2014-07-10 22:22:14.903688 7fef4cb907c0  1 journal _open /var/lib/ceph/osd/ceph-58/journal fd 19: 2147483648 bytes, block size 4096 bytes, directio = 1, aio = 0
2014-07-10 22:22:14.903772 7fef4cb907c0  1 journal _open /var/lib/ceph/osd/ceph-58/journal fd 19: 2147483648 bytes, block size 4096 bytes, directio = 1, aio = 0
2014-07-10 22:22:16.150319 7fef3de02700  1 osd.58 180 state: booting -> active
2014-07-10 22:22:16.153636 7fef385f7700  1 osd.58 pg_epoch: 180 pg[4.99d( empty local-les=177 n=0 ec=3 les/c 177/177 180/180/180) [58,46] r=0 lpr=180 pi=176-179/2 mlcod 0'0 inactive] state<Start>: transitioning to Primary
2014-07-10 22:22:16.153837 7fef385f7700  1 osd.58 pg_epoch: 180 pg[5.99c( empty local-les=177 n=0 ec=36 les/c 177/177 180/180/180) [58,46] r=0 lpr=180 pi=176-179/2 mlcod 0'0 inactive] state<Start>: transitioning to Primary
2014-07-10 22:22:16.154213 7fef385f7700  1 osd.58 pg_epoch: 180 pg[3.99b( empty local-les=177 n=0 ec=2 les/c 177/177 180/180/87) [53,58] r=1 lpr=180 pi=103-179/11 inactive NOTIFY] state<Start>: transitioning to Stray
2014-07-10 22:22:16.154446 7fef385f7700  1 osd.58 pg_epoch: 180 pg[4.991( empty local-les=177 n=0 ec=3 les/c 177/177 180/180/180) [58,12] r=0 lpr=180 pi=176-179/2 mlcod 0'0 inactive] state<Start>: transitioning to Primary
...
...
...
2014-07-10 22:22:16.494357 7fef385f7700  1 osd.58 pg_epoch: 180 pg[4.99a( empty local-les=177 n=0 ec=3 les/c 177/177 180/180/87) [53,58] r=1 lpr=180 pi=103-179/11 inactive NOTIFY] state<Start>: transitioning to Stray
2014-07-10 22:22:16.494702 7fef385f7700  1 osd.58 pg_epoch: 180 pg[3.99e( empty local-les=177 n=0 ec=2 les/c 177/177 180/180/180) [58,46] r=0 lpr=180 pi=176-179/2 mlcod 0'0 inactive] state<Start>: transitioning to Primary
2014-07-10 22:22:16.495135 7fef385f7700  1 osd.58 pg_epoch: 180 pg[5.999( empty local-les=177 n=0 ec=36 les/c 177/177 180/180/87) [53,58] r=1 lpr=180 pi=103-179/11 inactive NOTIFY] state<Start>: transitioning to Stray
2014-07-10 22:22:20.473994 7fef17a3f700  0 -- 10.1.33.8:6830/32411 >> 10.1.33.8:6823/32400 pipe(0x630e280 sd=376 :6830 s=0 pgs=0 cs=0 l=0 c=0x653d700).accept connect_seq 0 vs existing 0 state connecting
-------------------------------------------------------------------------------------------------------------------
BAD:
2014-07-10 22:22:14.508119 7f72212697c0  0 ceph version 0.67.8 (ffc58b4ea6a3ea10e91050aaa28d14d87dea5656), process ceph-osd, pid 31912
2014-07-10 22:22:14.513077 7f72212697c0  1 filestore(/var/lib/ceph/osd/ceph-60) mount detected xfs
2014-07-10 22:22:14.513094 7f72212697c0  1 filestore(/var/lib/ceph/osd/ceph-60)  disabling 'filestore replica fadvise' due to known issues with fadvise(DONTNEED) on xfs
2014-07-10 22:22:14.515584 7f72212697c0  0 filestore(/var/lib/ceph/osd/ceph-60) mount FIEMAP ioctl is supported and appears to work
2014-07-10 22:22:14.515614 7f72212697c0  0 filestore(/var/lib/ceph/osd/ceph-60) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
2014-07-10 22:22:14.515923 7f72212697c0  0 filestore(/var/lib/ceph/osd/ceph-60) mount did NOT detect btrfs
2014-07-10 22:22:14.516317 7f72212697c0  0 filestore(/var/lib/ceph/osd/ceph-60) mount syncfs(2) syscall fully supported (by glibc and kernel)
2014-07-10 22:22:14.516468 7f72212697c0  0 filestore(/var/lib/ceph/osd/ceph-60) mount found snaps <>
2014-07-10 22:22:14.518501 7f72212697c0  0 filestore(/var/lib/ceph/osd/ceph-60) mount: enabling WRITEAHEAD journal mode: btrfs not detected
2014-07-10 22:22:14.518742 7f72212697c0 -1 journal FileJournal::_open: disabling aio for non-block journal.  Use journal_force_aio to force use of aio anyway
2014-07-10 22:22:14.518771 7f72212697c0  1 journal _open /var/lib/ceph/osd/ceph-60/journal fd 19: 2147483648 bytes, block size 4096 bytes, directio = 1, aio = 0
2014-07-10 22:22:14.519224 7f72212697c0  1 journal _open /var/lib/ceph/osd/ceph-60/journal fd 19: 2147483648 bytes, block size 4096 bytes, directio = 1, aio = 0
2014-07-10 22:22:14.520070 7f72212697c0  1 journal close /var/lib/ceph/osd/ceph-60/journal
2014-07-10 22:22:14.521552 7f72212697c0  1 filestore(/var/lib/ceph/osd/ceph-60) mount detected xfs
2014-07-10 22:22:14.523703 7f72212697c0  0 filestore(/var/lib/ceph/osd/ceph-60) mount FIEMAP ioctl is supported and appears to work
2014-07-10 22:22:14.523724 7f72212697c0  0 filestore(/var/lib/ceph/osd/ceph-60) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
2014-07-10 22:22:14.524085 7f72212697c0  0 filestore(/var/lib/ceph/osd/ceph-60) mount did NOT detect btrfs
2014-07-10 22:22:14.524591 7f72212697c0  0 filestore(/var/lib/ceph/osd/ceph-60) mount syncfs(2) syscall fully supported (by glibc and kernel)
2014-07-10 22:22:14.524707 7f72212697c0  0 filestore(/var/lib/ceph/osd/ceph-60) mount found snaps <>
2014-07-10 22:22:14.526694 7f72212697c0  0 filestore(/var/lib/ceph/osd/ceph-60) mount: enabling WRITEAHEAD journal mode: btrfs not detected
2014-07-10 22:22:14.526868 7f72212697c0 -1 journal FileJournal::_open: disabling aio for non-block journal.  Use journal_force_aio to force use of aio anyway
2014-07-10 22:22:14.526894 7f72212697c0  1 journal _open /var/lib/ceph/osd/ceph-60/journal fd 19: 2147483648 bytes, block size 4096 bytes, directio = 1, aio = 0
2014-07-10 22:22:14.527111 7f72212697c0  1 journal _open /var/lib/ceph/osd/ceph-60/journal fd 19: 2147483648 bytes, block size 4096 bytes, directio = 1, aio = 0
-----------------------------------------------------------------------------------------------------------------------