API tools faq
paste
Advertisement
Guest User

ceph-nautilus-upgrade

a guest
Aug 27th, 2020
151
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 496.84 KB | None | 0 0
raw download clone embed print report
  1.  
  2. 2020-08-27 14:32:25.763162 7fe21a74e700 4 rocksdb: [/build/ceph-12.2.5/src/rocksdb/db/db_impl_files.cc:388] [JOB 56766] Try to delete WAL files size 256832821, prev total WAL file size 256870595, number of live WAL files 3.
  3.  
  4. 2020-08-27 14:34:23.997728 7fe210f3b700 4 rocksdb: [/build/ceph-12.2.5/src/rocksdb/db/db_impl_write.cc:684] reusing log 548349 from recycle list
  5.  
  6. 2020-08-27 14:34:23.997808 7fe210f3b700 4 rocksdb: [/build/ceph-12.2.5/src/rocksdb/db/db_impl_write.cc:725] [default] New memtable created with log file: #548354. Immutable memtables: 0.
  7.  
  8. 2020-08-27 14:35:19.378894 7fe232767700 0 -- 192.168.1.3:6822/3412269 >> 192.168.1.9:6812/4049812 conn(0x561951b23000 :6822 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 1165 vs existing csq=1165 existing_state=STATE_STANDBY
  9. 2020-08-27 14:35:19.379039 7fe232767700 0 -- 192.168.1.3:6822/3412269 >> 192.168.1.9:6812/4049812 conn(0x561951b23000 :6822 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 1166 vs existing csq=1165 existing_state=STATE_STANDBY
  10. 2020-08-27 14:35:26.056396 7fe201f1d700 -1 received signal: Terminated from PID: 1 task name: /sbin/init UID: 0
  11. 2020-08-27 14:35:26.056412 7fe201f1d700 -1 osd.108 489897 *** Got signal Terminated ***
  12. 2020-08-27 14:35:26.056419 7fe201f1d700 0 osd.108 489897 prepare_to_stop telling mon we are shutting down
  13. 2020-08-27 14:35:26.331822 7fe214fbc700 0 osd.108 489897 got_stop_ack starting shutdown
  14. 2020-08-27 14:35:26.331845 7fe201f1d700 0 osd.108 489897 prepare_to_stop starting shutdown
  15. 2020-08-27 14:35:26.331849 7fe201f1d700 -1 osd.108 489897 shutdown
  16. 2020-08-27 14:35:30.255518 7fe201f1d700 4 rocksdb: [/build/ceph-12.2.5/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
  17. 2020-08-27 14:35:30.276093 7fe201f1d700 4 rocksdb: [/build/ceph-12.2.5/src/rocksdb/db/db_impl.cc:343] Shutdown complete
  18. 2020-08-27 14:35:30.511250 7fe201f1d700 1 bluefs umount
  19. 2020-08-27 14:35:30.511652 7fe201f1d700 1 bdev(0x5619371ab680 /var/lib/ceph/osd/ceph-108/block.wal) close
  20. 2020-08-27 14:35:30.789103 7fe201f1d700 1 bdev(0x5619371ab200 /var/lib/ceph/osd/ceph-108/block.db) close
  21. 2020-08-27 14:35:30.857006 7fe201f1d700 1 bdev(0x5619371ab440 /var/lib/ceph/osd/ceph-108/block) close
  22. 2020-08-27 14:35:31.028862 7fe201f1d700 1 bdev(0x5619371aafc0 /var/lib/ceph/osd/ceph-108/block) close
  23. 2020-08-27 14:40:59.752 7f0e0ebf2c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  24. 2020-08-27 14:40:59.752 7f0e0ebf2c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3554078
  25. 2020-08-27 14:40:59.752 7f0e0ebf2c00 0 pidfile_write: ignore empty --pid-file
  26. 2020-08-27 14:40:59.752 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  27. 2020-08-27 14:40:59.752 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  28. 2020-08-27 14:40:59.752 7f0e0ebf2c00 0 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  29. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  30. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  31. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  32. 2020-08-27 14:40:59.756 7f0e0ebf2c00 0 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  33. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  34. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  35. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  36. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  37. 2020-08-27 14:40:59.756 7f0e0ebf2c00 0 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  38. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  39. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  40. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  41. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  42. 2020-08-27 14:40:59.756 7f0e0ebf2c00 0 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  43. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  44. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  45. 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  46. 2020-08-27 14:41:00.088 7f0e0ebf2c00 1 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block.db) close
  47. 2020-08-27 14:41:00.280 7f0e0ebf2c00 1 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block) close
  48. 2020-08-27 14:41:00.536 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) close
  49. 2020-08-27 14:41:00.796 7f0e0ebf2c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  50. 2020-08-27 14:41:00.808 7f0e0ebf2c00 0 load: jerasure load: lrc load: isa
  51. 2020-08-27 14:41:00.808 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  52. 2020-08-27 14:41:00.808 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  53. 2020-08-27 14:41:00.808 7f0e0ebf2c00 0 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  54. 2020-08-27 14:41:00.808 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  55. 2020-08-27 14:41:00.808 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) close
  56. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  57. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  58. 2020-08-27 14:41:01.132 7f0e0ebf2c00 0 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  59. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  60. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  61. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  62. 2020-08-27 14:41:01.132 7f0e0ebf2c00 0 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  63. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  64. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  65. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  66. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  67. 2020-08-27 14:41:01.132 7f0e0ebf2c00 0 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  68. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  69. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  70. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  71. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  72. 2020-08-27 14:41:01.132 7f0e0ebf2c00 0 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  73. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  74. 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  75. 2020-08-27 14:41:01.132 7f0e0ebf2c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  76. 2020-08-27 14:41:01.132 7f0e0ebf2c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  77. 2020-08-27 14:41:01.136 7f0e0ebf2c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f0e0ebf2c00 time 2020-08-27 14:41:01.135973
  78. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  79.  
  80. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  81. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  82. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  83. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  84. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  85. 5: (OSD::init()+0x3f3) [0x8f5483]
  86. 6: (main()+0x27e2) [0x84c462]
  87. 7: (__libc_start_main()+0xf0) [0x7f0e0bda3830]
  88. 8: (_start()+0x29) [0x880389]
  89.  
  90. 2020-08-27 14:41:01.140 7f0e0ebf2c00 -1 *** Caught signal (Aborted) **
  91. in thread 7f0e0ebf2c00 thread_name:ceph-osd
  92.  
  93. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  94. 1: (()+0x11390) [0x7f0e0c88d390]
  95. 2: (gsignal()+0x38) [0x7f0e0bdb8428]
  96. 3: (abort()+0x16a) [0x7f0e0bdba02a]
  97. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  98. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  99. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  100. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  101. 8: (OSD::init()+0x3f3) [0x8f5483]
  102. 9: (main()+0x27e2) [0x84c462]
  103. 10: (__libc_start_main()+0xf0) [0x7f0e0bda3830]
  104. 11: (_start()+0x29) [0x880389]
  105. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  106.  
  107. --- begin dump of recent events ---
  108. -77> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command assert hook 0xaa26100
  109. -76> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command abort hook 0xaa26100
  110. -75> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command perfcounters_dump hook 0xaa26100
  111. -74> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command 1 hook 0xaa26100
  112. -73> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command perf dump hook 0xaa26100
  113. -72> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command perfcounters_schema hook 0xaa26100
  114. -71> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command perf histogram dump hook 0xaa26100
  115. -70> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command 2 hook 0xaa26100
  116. -69> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command perf schema hook 0xaa26100
  117. -68> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command perf histogram schema hook 0xaa26100
  118. -67> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command perf reset hook 0xaa26100
  119. -66> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command config show hook 0xaa26100
  120. -65> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command config help hook 0xaa26100
  121. -64> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command config set hook 0xaa26100
  122. -63> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command config unset hook 0xaa26100
  123. -62> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command config get hook 0xaa26100
  124. -61> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command config diff hook 0xaa26100
  125. -60> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command config diff get hook 0xaa26100
  126. -59> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command log flush hook 0xaa26100
  127. -58> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command log dump hook 0xaa26100
  128. -57> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command log reopen hook 0xaa26100
  129. -56> 2020-08-27 14:40:59.740 7f0e0ebf2c00 5 asok(0xaaec000) register_command dump_mempools hook 0xb6e4068
  130. -55> 2020-08-27 14:40:59.752 7f0e0ebf2c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  131. -54> 2020-08-27 14:40:59.752 7f0e0ebf2c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3554078
  132. -53> 2020-08-27 14:40:59.752 7f0e0ebf2c00 0 pidfile_write: ignore empty --pid-file
  133. -52> 2020-08-27 14:40:59.752 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  134. -51> 2020-08-27 14:40:59.752 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  135. -50> 2020-08-27 14:40:59.752 7f0e0ebf2c00 0 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  136. -49> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  137. -48> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  138. -47> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  139. -46> 2020-08-27 14:40:59.756 7f0e0ebf2c00 0 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  140. -45> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  141. -44> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  142. -43> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  143. -42> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  144. -41> 2020-08-27 14:40:59.756 7f0e0ebf2c00 0 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  145. -40> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  146. -39> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  147. -38> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  148. -37> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  149. -36> 2020-08-27 14:40:59.756 7f0e0ebf2c00 0 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  150. -35> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  151. -34> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  152. -33> 2020-08-27 14:40:59.756 7f0e0ebf2c00 1 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  153. -32> 2020-08-27 14:41:00.088 7f0e0ebf2c00 1 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block.db) close
  154. -31> 2020-08-27 14:41:00.280 7f0e0ebf2c00 1 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block) close
  155. -30> 2020-08-27 14:41:00.536 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) close
  156. -29> 2020-08-27 14:41:00.796 7f0e0ebf2c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  157. -28> 2020-08-27 14:41:00.808 7f0e0ebf2c00 0 load: jerasure load: lrc load: isa
  158. -27> 2020-08-27 14:41:00.808 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  159. -26> 2020-08-27 14:41:00.808 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  160. -25> 2020-08-27 14:41:00.808 7f0e0ebf2c00 0 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  161. -24> 2020-08-27 14:41:00.808 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  162. -23> 2020-08-27 14:41:00.808 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) close
  163. -22> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  164. -21> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  165. -20> 2020-08-27 14:41:01.132 7f0e0ebf2c00 0 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  166. -19> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  167. -18> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  168. -17> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  169. -16> 2020-08-27 14:41:01.132 7f0e0ebf2c00 0 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  170. -15> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  171. -14> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  172. -13> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  173. -12> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  174. -11> 2020-08-27 14:41:01.132 7f0e0ebf2c00 0 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  175. -10> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  176. -9> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  177. -8> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  178. -7> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  179. -6> 2020-08-27 14:41:01.132 7f0e0ebf2c00 0 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  180. -5> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bdev(0xb7e2a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  181. -4> 2020-08-27 14:41:01.132 7f0e0ebf2c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  182. -3> 2020-08-27 14:41:01.132 7f0e0ebf2c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  183. -2> 2020-08-27 14:41:01.132 7f0e0ebf2c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  184. -1> 2020-08-27 14:41:01.136 7f0e0ebf2c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f0e0ebf2c00 time 2020-08-27 14:41:01.135973
  185. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  186.  
  187. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  188. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  189. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  190. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  191. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  192. 5: (OSD::init()+0x3f3) [0x8f5483]
  193. 6: (main()+0x27e2) [0x84c462]
  194. 7: (__libc_start_main()+0xf0) [0x7f0e0bda3830]
  195. 8: (_start()+0x29) [0x880389]
  196.  
  197. 0> 2020-08-27 14:41:01.140 7f0e0ebf2c00 -1 *** Caught signal (Aborted) **
  198. in thread 7f0e0ebf2c00 thread_name:ceph-osd
  199.  
  200. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  201. 1: (()+0x11390) [0x7f0e0c88d390]
  202. 2: (gsignal()+0x38) [0x7f0e0bdb8428]
  203. 3: (abort()+0x16a) [0x7f0e0bdba02a]
  204. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  205. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  206. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  207. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  208. 8: (OSD::init()+0x3f3) [0x8f5483]
  209. 9: (main()+0x27e2) [0x84c462]
  210. 10: (__libc_start_main()+0xf0) [0x7f0e0bda3830]
  211. 11: (_start()+0x29) [0x880389]
  212. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  213.  
  214. --- logging levels ---
  215. 0/ 5 none
  216. 0/ 0 lockdep
  217. 0/ 0 context
  218. 0/ 0 crush
  219. 1/ 5 mds
  220. 1/ 5 mds_balancer
  221. 1/ 5 mds_locker
  222. 1/ 5 mds_log
  223. 1/ 5 mds_log_expire
  224. 1/ 5 mds_migrator
  225. 0/ 0 buffer
  226. 0/ 0 timer
  227. 0/ 0 filer
  228. 0/ 1 striper
  229. 0/ 0 objecter
  230. 0/ 0 rados
  231. 0/ 0 rbd
  232. 0/ 5 rbd_mirror
  233. 0/ 5 rbd_replay
  234. 0/ 0 journaler
  235. 0/ 0 objectcacher
  236. 0/ 0 client
  237. 0/ 0 osd
  238. 0/ 0 optracker
  239. 0/ 0 objclass
  240. 0/ 0 filestore
  241. 0/ 0 journal
  242. 0/ 0 ms
  243. 0/ 0 mon
  244. 0/ 0 monc
  245. 0/ 0 paxos
  246. 0/ 0 tp
  247. 0/ 0 auth
  248. 1/ 5 crypto
  249. 0/ 0 finisher
  250. 1/ 1 reserver
  251. 0/ 0 heartbeatmap
  252. 0/ 0 perfcounter
  253. 0/ 0 rgw
  254. 1/ 5 rgw_sync
  255. 1/10 civetweb
  256. 1/ 5 javaclient
  257. 0/ 0 asok
  258. 0/ 0 throttle
  259. 0/ 0 refs
  260. 1/ 5 xio
  261. 1/ 5 compressor
  262. 0/ 0 bluestore
  263. 1/ 5 bluefs
  264. 1/ 3 bdev
  265. 1/ 5 kstore
  266. 4/ 5 rocksdb
  267. 4/ 5 leveldb
  268. 4/ 5 memdb
  269. 1/ 5 kinetic
  270. 1/ 5 fuse
  271. 1/ 5 mgr
  272. 1/ 5 mgrc
  273. 1/ 5 dpdk
  274. 1/ 5 eventtrace
  275. 1/ 5 prioritycache
  276. -2/-2 (syslog threshold)
  277. -1/-1 (stderr threshold)
  278. max_recent 10000
  279. max_new 1000
  280. log_file /var/log/ceph/ceph-osd.108.log
  281. --- end dump of recent events ---
  282. 2020-08-27 14:41:01.740 7fdf5b1e9c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  283. 2020-08-27 14:41:01.740 7fdf5b1e9c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3554286
  284. 2020-08-27 14:41:01.740 7fdf5b1e9c00 0 pidfile_write: ignore empty --pid-file
  285. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  286. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  287. 2020-08-27 14:41:01.744 7fdf5b1e9c00 0 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  288. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  289. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  290. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  291. 2020-08-27 14:41:01.744 7fdf5b1e9c00 0 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  292. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  293. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  294. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  295. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  296. 2020-08-27 14:41:01.744 7fdf5b1e9c00 0 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  297. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  298. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  299. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  300. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  301. 2020-08-27 14:41:01.744 7fdf5b1e9c00 0 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  302. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  303. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  304. 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  305. 2020-08-27 14:41:02.052 7fdf5b1e9c00 1 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block.db) close
  306. 2020-08-27 14:41:02.280 7fdf5b1e9c00 1 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block) close
  307. 2020-08-27 14:41:02.528 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) close
  308. 2020-08-27 14:41:02.816 7fdf5b1e9c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  309. 2020-08-27 14:41:02.828 7fdf5b1e9c00 0 load: jerasure load: lrc load: isa
  310. 2020-08-27 14:41:02.828 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  311. 2020-08-27 14:41:02.828 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  312. 2020-08-27 14:41:02.828 7fdf5b1e9c00 0 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  313. 2020-08-27 14:41:02.828 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  314. 2020-08-27 14:41:02.828 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) close
  315. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  316. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  317. 2020-08-27 14:41:03.120 7fdf5b1e9c00 0 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  318. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  319. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  320. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  321. 2020-08-27 14:41:03.120 7fdf5b1e9c00 0 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  322. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  323. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  324. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  325. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  326. 2020-08-27 14:41:03.120 7fdf5b1e9c00 0 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  327. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  328. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  329. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  330. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  331. 2020-08-27 14:41:03.120 7fdf5b1e9c00 0 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  332. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  333. 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  334. 2020-08-27 14:41:03.120 7fdf5b1e9c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  335. 2020-08-27 14:41:03.120 7fdf5b1e9c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  336. 2020-08-27 14:41:03.124 7fdf5b1e9c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7fdf5b1e9c00 time 2020-08-27 14:41:03.123337
  337. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  338.  
  339. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  340. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  341. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  342. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  343. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  344. 5: (OSD::init()+0x3f3) [0x8f5483]
  345. 6: (main()+0x27e2) [0x84c462]
  346. 7: (__libc_start_main()+0xf0) [0x7fdf5839a830]
  347. 8: (_start()+0x29) [0x880389]
  348.  
  349. 2020-08-27 14:41:03.124 7fdf5b1e9c00 -1 *** Caught signal (Aborted) **
  350. in thread 7fdf5b1e9c00 thread_name:ceph-osd
  351.  
  352. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  353. 1: (()+0x11390) [0x7fdf58e84390]
  354. 2: (gsignal()+0x38) [0x7fdf583af428]
  355. 3: (abort()+0x16a) [0x7fdf583b102a]
  356. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  357. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  358. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  359. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  360. 8: (OSD::init()+0x3f3) [0x8f5483]
  361. 9: (main()+0x27e2) [0x84c462]
  362. 10: (__libc_start_main()+0xf0) [0x7fdf5839a830]
  363. 11: (_start()+0x29) [0x880389]
  364. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  365.  
  366. --- begin dump of recent events ---
  367. -77> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command assert hook 0xbf2a100
  368. -76> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command abort hook 0xbf2a100
  369. -75> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command perfcounters_dump hook 0xbf2a100
  370. -74> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command 1 hook 0xbf2a100
  371. -73> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command perf dump hook 0xbf2a100
  372. -72> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command perfcounters_schema hook 0xbf2a100
  373. -71> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command perf histogram dump hook 0xbf2a100
  374. -70> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command 2 hook 0xbf2a100
  375. -69> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command perf schema hook 0xbf2a100
  376. -68> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command perf histogram schema hook 0xbf2a100
  377. -67> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command perf reset hook 0xbf2a100
  378. -66> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command config show hook 0xbf2a100
  379. -65> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command config help hook 0xbf2a100
  380. -64> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command config set hook 0xbf2a100
  381. -63> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command config unset hook 0xbf2a100
  382. -62> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command config get hook 0xbf2a100
  383. -61> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command config diff hook 0xbf2a100
  384. -60> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command config diff get hook 0xbf2a100
  385. -59> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command log flush hook 0xbf2a100
  386. -58> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command log dump hook 0xbf2a100
  387. -57> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command log reopen hook 0xbf2a100
  388. -56> 2020-08-27 14:41:01.728 7fdf5b1e9c00 5 asok(0xbff0000) register_command dump_mempools hook 0xcbe8068
  389. -55> 2020-08-27 14:41:01.740 7fdf5b1e9c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  390. -54> 2020-08-27 14:41:01.740 7fdf5b1e9c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3554286
  391. -53> 2020-08-27 14:41:01.740 7fdf5b1e9c00 0 pidfile_write: ignore empty --pid-file
  392. -52> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  393. -51> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  394. -50> 2020-08-27 14:41:01.744 7fdf5b1e9c00 0 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  395. -49> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  396. -48> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  397. -47> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  398. -46> 2020-08-27 14:41:01.744 7fdf5b1e9c00 0 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  399. -45> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  400. -44> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  401. -43> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  402. -42> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  403. -41> 2020-08-27 14:41:01.744 7fdf5b1e9c00 0 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  404. -40> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  405. -39> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  406. -38> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  407. -37> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  408. -36> 2020-08-27 14:41:01.744 7fdf5b1e9c00 0 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  409. -35> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  410. -34> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  411. -33> 2020-08-27 14:41:01.744 7fdf5b1e9c00 1 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  412. -32> 2020-08-27 14:41:02.052 7fdf5b1e9c00 1 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block.db) close
  413. -31> 2020-08-27 14:41:02.280 7fdf5b1e9c00 1 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block) close
  414. -30> 2020-08-27 14:41:02.528 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) close
  415. -29> 2020-08-27 14:41:02.816 7fdf5b1e9c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  416. -28> 2020-08-27 14:41:02.828 7fdf5b1e9c00 0 load: jerasure load: lrc load: isa
  417. -27> 2020-08-27 14:41:02.828 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  418. -26> 2020-08-27 14:41:02.828 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  419. -25> 2020-08-27 14:41:02.828 7fdf5b1e9c00 0 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  420. -24> 2020-08-27 14:41:02.828 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  421. -23> 2020-08-27 14:41:02.828 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) close
  422. -22> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  423. -21> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  424. -20> 2020-08-27 14:41:03.120 7fdf5b1e9c00 0 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  425. -19> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  426. -18> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  427. -17> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  428. -16> 2020-08-27 14:41:03.120 7fdf5b1e9c00 0 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  429. -15> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  430. -14> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  431. -13> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  432. -12> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  433. -11> 2020-08-27 14:41:03.120 7fdf5b1e9c00 0 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  434. -10> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  435. -9> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  436. -8> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  437. -7> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  438. -6> 2020-08-27 14:41:03.120 7fdf5b1e9c00 0 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  439. -5> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bdev(0xcce6a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  440. -4> 2020-08-27 14:41:03.120 7fdf5b1e9c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  441. -3> 2020-08-27 14:41:03.120 7fdf5b1e9c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  442. -2> 2020-08-27 14:41:03.120 7fdf5b1e9c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  443. -1> 2020-08-27 14:41:03.124 7fdf5b1e9c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7fdf5b1e9c00 time 2020-08-27 14:41:03.123337
  444. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  445.  
  446. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  447. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  448. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  449. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  450. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  451. 5: (OSD::init()+0x3f3) [0x8f5483]
  452. 6: (main()+0x27e2) [0x84c462]
  453. 7: (__libc_start_main()+0xf0) [0x7fdf5839a830]
  454. 8: (_start()+0x29) [0x880389]
  455.  
  456. 0> 2020-08-27 14:41:03.124 7fdf5b1e9c00 -1 *** Caught signal (Aborted) **
  457. in thread 7fdf5b1e9c00 thread_name:ceph-osd
  458.  
  459. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  460. 1: (()+0x11390) [0x7fdf58e84390]
  461. 2: (gsignal()+0x38) [0x7fdf583af428]
  462. 3: (abort()+0x16a) [0x7fdf583b102a]
  463. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  464. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  465. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  466. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  467. 8: (OSD::init()+0x3f3) [0x8f5483]
  468. 9: (main()+0x27e2) [0x84c462]
  469. 10: (__libc_start_main()+0xf0) [0x7fdf5839a830]
  470. 11: (_start()+0x29) [0x880389]
  471. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  472.  
  473. --- logging levels ---
  474. 0/ 5 none
  475. 0/ 0 lockdep
  476. 0/ 0 context
  477. 0/ 0 crush
  478. 1/ 5 mds
  479. 1/ 5 mds_balancer
  480. 1/ 5 mds_locker
  481. 1/ 5 mds_log
  482. 1/ 5 mds_log_expire
  483. 1/ 5 mds_migrator
  484. 0/ 0 buffer
  485. 0/ 0 timer
  486. 0/ 0 filer
  487. 0/ 1 striper
  488. 0/ 0 objecter
  489. 0/ 0 rados
  490. 0/ 0 rbd
  491. 0/ 5 rbd_mirror
  492. 0/ 5 rbd_replay
  493. 0/ 0 journaler
  494. 0/ 0 objectcacher
  495. 0/ 0 client
  496. 0/ 0 osd
  497. 0/ 0 optracker
  498. 0/ 0 objclass
  499. 0/ 0 filestore
  500. 0/ 0 journal
  501. 0/ 0 ms
  502. 0/ 0 mon
  503. 0/ 0 monc
  504. 0/ 0 paxos
  505. 0/ 0 tp
  506. 0/ 0 auth
  507. 1/ 5 crypto
  508. 0/ 0 finisher
  509. 1/ 1 reserver
  510. 0/ 0 heartbeatmap
  511. 0/ 0 perfcounter
  512. 0/ 0 rgw
  513. 1/ 5 rgw_sync
  514. 1/10 civetweb
  515. 1/ 5 javaclient
  516. 0/ 0 asok
  517. 0/ 0 throttle
  518. 0/ 0 refs
  519. 1/ 5 xio
  520. 1/ 5 compressor
  521. 0/ 0 bluestore
  522. 1/ 5 bluefs
  523. 1/ 3 bdev
  524. 1/ 5 kstore
  525. 4/ 5 rocksdb
  526. 4/ 5 leveldb
  527. 4/ 5 memdb
  528. 1/ 5 kinetic
  529. 1/ 5 fuse
  530. 1/ 5 mgr
  531. 1/ 5 mgrc
  532. 1/ 5 dpdk
  533. 1/ 5 eventtrace
  534. 1/ 5 prioritycache
  535. -2/-2 (syslog threshold)
  536. -1/-1 (stderr threshold)
  537. max_recent 10000
  538. max_new 1000
  539. log_file /var/log/ceph/ceph-osd.108.log
  540. --- end dump of recent events ---
  541. 2020-08-27 14:41:03.692 7f1d526bfc00 0 set uid:gid to 64045:64045 (ceph:ceph)
  542. 2020-08-27 14:41:03.692 7f1d526bfc00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3554586
  543. 2020-08-27 14:41:03.692 7f1d526bfc00 0 pidfile_write: ignore empty --pid-file
  544. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  545. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  546. 2020-08-27 14:41:03.696 7f1d526bfc00 0 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  547. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  548. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  549. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  550. 2020-08-27 14:41:03.696 7f1d526bfc00 0 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  551. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  552. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  553. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  554. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  555. 2020-08-27 14:41:03.696 7f1d526bfc00 0 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  556. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  557. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  558. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  559. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  560. 2020-08-27 14:41:03.696 7f1d526bfc00 0 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  561. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  562. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  563. 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  564. 2020-08-27 14:41:03.996 7f1d526bfc00 1 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block.db) close
  565. 2020-08-27 14:41:04.252 7f1d526bfc00 1 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block) close
  566. 2020-08-27 14:41:04.496 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) close
  567. 2020-08-27 14:41:04.752 7f1d526bfc00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  568. 2020-08-27 14:41:04.760 7f1d526bfc00 0 load: jerasure load: lrc load: isa
  569. 2020-08-27 14:41:04.760 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  570. 2020-08-27 14:41:04.760 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  571. 2020-08-27 14:41:04.760 7f1d526bfc00 0 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  572. 2020-08-27 14:41:04.760 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  573. 2020-08-27 14:41:04.760 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) close
  574. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  575. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  576. 2020-08-27 14:41:05.084 7f1d526bfc00 0 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  577. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  578. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  579. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  580. 2020-08-27 14:41:05.084 7f1d526bfc00 0 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  581. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  582. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  583. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  584. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  585. 2020-08-27 14:41:05.084 7f1d526bfc00 0 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  586. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  587. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  588. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  589. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  590. 2020-08-27 14:41:05.084 7f1d526bfc00 0 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  591. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  592. 2020-08-27 14:41:05.084 7f1d526bfc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  593. 2020-08-27 14:41:05.084 7f1d526bfc00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  594. 2020-08-27 14:41:05.084 7f1d526bfc00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  595. 2020-08-27 14:41:05.088 7f1d526bfc00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f1d526bfc00 time 2020-08-27 14:41:05.088199
  596. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  597.  
  598. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  599. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  600. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  601. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  602. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  603. 5: (OSD::init()+0x3f3) [0x8f5483]
  604. 6: (main()+0x27e2) [0x84c462]
  605. 7: (__libc_start_main()+0xf0) [0x7f1d4f870830]
  606. 8: (_start()+0x29) [0x880389]
  607.  
  608. 2020-08-27 14:41:05.092 7f1d526bfc00 -1 *** Caught signal (Aborted) **
  609. in thread 7f1d526bfc00 thread_name:ceph-osd
  610.  
  611. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  612. 1: (()+0x11390) [0x7f1d5035a390]
  613. 2: (gsignal()+0x38) [0x7f1d4f885428]
  614. 3: (abort()+0x16a) [0x7f1d4f88702a]
  615. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  616. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  617. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  618. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  619. 8: (OSD::init()+0x3f3) [0x8f5483]
  620. 9: (main()+0x27e2) [0x84c462]
  621. 10: (__libc_start_main()+0xf0) [0x7f1d4f870830]
  622. 11: (_start()+0x29) [0x880389]
  623. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  624.  
  625. --- begin dump of recent events ---
  626. -77> 2020-08-27 14:41:03.680 7f1d526bfc00 5 asok(0xb548000) register_command assert hook 0xb482100
  627. -76> 2020-08-27 14:41:03.680 7f1d526bfc00 5 asok(0xb548000) register_command abort hook 0xb482100
  628. -75> 2020-08-27 14:41:03.680 7f1d526bfc00 5 asok(0xb548000) register_command perfcounters_dump hook 0xb482100
  629. -74> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command 1 hook 0xb482100
  630. -73> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command perf dump hook 0xb482100
  631. -72> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command perfcounters_schema hook 0xb482100
  632. -71> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command perf histogram dump hook 0xb482100
  633. -70> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command 2 hook 0xb482100
  634. -69> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command perf schema hook 0xb482100
  635. -68> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command perf histogram schema hook 0xb482100
  636. -67> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command perf reset hook 0xb482100
  637. -66> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command config show hook 0xb482100
  638. -65> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command config help hook 0xb482100
  639. -64> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command config set hook 0xb482100
  640. -63> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command config unset hook 0xb482100
  641. -62> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command config get hook 0xb482100
  642. -61> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command config diff hook 0xb482100
  643. -60> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command config diff get hook 0xb482100
  644. -59> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command log flush hook 0xb482100
  645. -58> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command log dump hook 0xb482100
  646. -57> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command log reopen hook 0xb482100
  647. -56> 2020-08-27 14:41:03.684 7f1d526bfc00 5 asok(0xb548000) register_command dump_mempools hook 0xc140068
  648. -55> 2020-08-27 14:41:03.692 7f1d526bfc00 0 set uid:gid to 64045:64045 (ceph:ceph)
  649. -54> 2020-08-27 14:41:03.692 7f1d526bfc00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3554586
  650. -53> 2020-08-27 14:41:03.692 7f1d526bfc00 0 pidfile_write: ignore empty --pid-file
  651. -52> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  652. -51> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  653. -50> 2020-08-27 14:41:03.696 7f1d526bfc00 0 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  654. -49> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  655. -48> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  656. -47> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  657. -46> 2020-08-27 14:41:03.696 7f1d526bfc00 0 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  658. -45> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  659. -44> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  660. -43> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  661. -42> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  662. -41> 2020-08-27 14:41:03.696 7f1d526bfc00 0 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  663. -40> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  664. -39> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  665. -38> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  666. -37> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  667. -36> 2020-08-27 14:41:03.696 7f1d526bfc00 0 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  668. -35> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  669. -34> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  670. -33> 2020-08-27 14:41:03.696 7f1d526bfc00 1 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  671. -32> 2020-08-27 14:41:03.996 7f1d526bfc00 1 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block.db) close
  672. -31> 2020-08-27 14:41:04.252 7f1d526bfc00 1 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block) close
  673. -30> 2020-08-27 14:41:04.496 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) close
  674. -29> 2020-08-27 14:41:04.752 7f1d526bfc00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  675. -28> 2020-08-27 14:41:04.760 7f1d526bfc00 0 load: jerasure load: lrc load: isa
  676. -27> 2020-08-27 14:41:04.760 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  677. -26> 2020-08-27 14:41:04.760 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  678. -25> 2020-08-27 14:41:04.760 7f1d526bfc00 0 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  679. -24> 2020-08-27 14:41:04.760 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  680. -23> 2020-08-27 14:41:04.760 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) close
  681. -22> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  682. -21> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  683. -20> 2020-08-27 14:41:05.084 7f1d526bfc00 0 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  684. -19> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  685. -18> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  686. -17> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  687. -16> 2020-08-27 14:41:05.084 7f1d526bfc00 0 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  688. -15> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  689. -14> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  690. -13> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  691. -12> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  692. -11> 2020-08-27 14:41:05.084 7f1d526bfc00 0 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  693. -10> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  694. -9> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  695. -8> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  696. -7> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  697. -6> 2020-08-27 14:41:05.084 7f1d526bfc00 0 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  698. -5> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bdev(0xc242a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  699. -4> 2020-08-27 14:41:05.084 7f1d526bfc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  700. -3> 2020-08-27 14:41:05.084 7f1d526bfc00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  701. -2> 2020-08-27 14:41:05.084 7f1d526bfc00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  702. -1> 2020-08-27 14:41:05.088 7f1d526bfc00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f1d526bfc00 time 2020-08-27 14:41:05.088199
  703. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  704.  
  705. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  706. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  707. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  708. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  709. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  710. 5: (OSD::init()+0x3f3) [0x8f5483]
  711. 6: (main()+0x27e2) [0x84c462]
  712. 7: (__libc_start_main()+0xf0) [0x7f1d4f870830]
  713. 8: (_start()+0x29) [0x880389]
  714.  
  715. 0> 2020-08-27 14:41:05.092 7f1d526bfc00 -1 *** Caught signal (Aborted) **
  716. in thread 7f1d526bfc00 thread_name:ceph-osd
  717.  
  718. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  719. 1: (()+0x11390) [0x7f1d5035a390]
  720. 2: (gsignal()+0x38) [0x7f1d4f885428]
  721. 3: (abort()+0x16a) [0x7f1d4f88702a]
  722. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  723. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  724. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  725. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  726. 8: (OSD::init()+0x3f3) [0x8f5483]
  727. 9: (main()+0x27e2) [0x84c462]
  728. 10: (__libc_start_main()+0xf0) [0x7f1d4f870830]
  729. 11: (_start()+0x29) [0x880389]
  730. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  731.  
  732. --- logging levels ---
  733. 0/ 5 none
  734. 0/ 0 lockdep
  735. 0/ 0 context
  736. 0/ 0 crush
  737. 1/ 5 mds
  738. 1/ 5 mds_balancer
  739. 1/ 5 mds_locker
  740. 1/ 5 mds_log
  741. 1/ 5 mds_log_expire
  742. 1/ 5 mds_migrator
  743. 0/ 0 buffer
  744. 0/ 0 timer
  745. 0/ 0 filer
  746. 0/ 1 striper
  747. 0/ 0 objecter
  748. 0/ 0 rados
  749. 0/ 0 rbd
  750. 0/ 5 rbd_mirror
  751. 0/ 5 rbd_replay
  752. 0/ 0 journaler
  753. 0/ 0 objectcacher
  754. 0/ 0 client
  755. 0/ 0 osd
  756. 0/ 0 optracker
  757. 0/ 0 objclass
  758. 0/ 0 filestore
  759. 0/ 0 journal
  760. 0/ 0 ms
  761. 0/ 0 mon
  762. 0/ 0 monc
  763. 0/ 0 paxos
  764. 0/ 0 tp
  765. 0/ 0 auth
  766. 1/ 5 crypto
  767. 0/ 0 finisher
  768. 1/ 1 reserver
  769. 0/ 0 heartbeatmap
  770. 0/ 0 perfcounter
  771. 0/ 0 rgw
  772. 1/ 5 rgw_sync
  773. 1/10 civetweb
  774. 1/ 5 javaclient
  775. 0/ 0 asok
  776. 0/ 0 throttle
  777. 0/ 0 refs
  778. 1/ 5 xio
  779. 1/ 5 compressor
  780. 0/ 0 bluestore
  781. 1/ 5 bluefs
  782. 1/ 3 bdev
  783. 1/ 5 kstore
  784. 4/ 5 rocksdb
  785. 4/ 5 leveldb
  786. 4/ 5 memdb
  787. 1/ 5 kinetic
  788. 1/ 5 fuse
  789. 1/ 5 mgr
  790. 1/ 5 mgrc
  791. 1/ 5 dpdk
  792. 1/ 5 eventtrace
  793. 1/ 5 prioritycache
  794. -2/-2 (syslog threshold)
  795. -1/-1 (stderr threshold)
  796. max_recent 10000
  797. max_new 1000
  798. log_file /var/log/ceph/ceph-osd.108.log
  799. --- end dump of recent events ---
  800. 2020-08-27 14:41:05.624 7f108e316c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  801. 2020-08-27 14:41:05.624 7f108e316c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3554941
  802. 2020-08-27 14:41:05.624 7f108e316c00 0 pidfile_write: ignore empty --pid-file
  803. 2020-08-27 14:41:05.624 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  804. 2020-08-27 14:41:05.624 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  805. 2020-08-27 14:41:05.624 7f108e316c00 0 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  806. 2020-08-27 14:41:05.624 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  807. 2020-08-27 14:41:05.624 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  808. 2020-08-27 14:41:05.624 7f108e316c00 1 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  809. 2020-08-27 14:41:05.624 7f108e316c00 0 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  810. 2020-08-27 14:41:05.624 7f108e316c00 1 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  811. 2020-08-27 14:41:05.624 7f108e316c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  812. 2020-08-27 14:41:05.628 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  813. 2020-08-27 14:41:05.628 7f108e316c00 1 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  814. 2020-08-27 14:41:05.628 7f108e316c00 0 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  815. 2020-08-27 14:41:05.628 7f108e316c00 1 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  816. 2020-08-27 14:41:05.628 7f108e316c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  817. 2020-08-27 14:41:05.628 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  818. 2020-08-27 14:41:05.628 7f108e316c00 1 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  819. 2020-08-27 14:41:05.628 7f108e316c00 0 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  820. 2020-08-27 14:41:05.628 7f108e316c00 1 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  821. 2020-08-27 14:41:05.628 7f108e316c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  822. 2020-08-27 14:41:05.628 7f108e316c00 1 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  823. 2020-08-27 14:41:05.936 7f108e316c00 1 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block.db) close
  824. 2020-08-27 14:41:06.208 7f108e316c00 1 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block) close
  825. 2020-08-27 14:41:06.440 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) close
  826. 2020-08-27 14:41:06.680 7f108e316c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  827. 2020-08-27 14:41:06.688 7f108e316c00 0 load: jerasure load: lrc load: isa
  828. 2020-08-27 14:41:06.688 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  829. 2020-08-27 14:41:06.688 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  830. 2020-08-27 14:41:06.688 7f108e316c00 0 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  831. 2020-08-27 14:41:06.688 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  832. 2020-08-27 14:41:06.688 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) close
  833. 2020-08-27 14:41:07.000 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  834. 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  835. 2020-08-27 14:41:07.000 7f108e316c00 0 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  836. 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  837. 2020-08-27 14:41:07.000 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  838. 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  839. 2020-08-27 14:41:07.000 7f108e316c00 0 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  840. 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  841. 2020-08-27 14:41:07.000 7f108e316c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  842. 2020-08-27 14:41:07.000 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  843. 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  844. 2020-08-27 14:41:07.000 7f108e316c00 0 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  845. 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  846. 2020-08-27 14:41:07.000 7f108e316c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  847. 2020-08-27 14:41:07.000 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  848. 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  849. 2020-08-27 14:41:07.000 7f108e316c00 0 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  850. 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  851. 2020-08-27 14:41:07.000 7f108e316c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  852. 2020-08-27 14:41:07.000 7f108e316c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  853. 2020-08-27 14:41:07.000 7f108e316c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  854. 2020-08-27 14:41:07.004 7f108e316c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f108e316c00 time 2020-08-27 14:41:07.003977
  855. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  856.  
  857. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  858. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  859. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  860. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  861. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  862. 5: (OSD::init()+0x3f3) [0x8f5483]
  863. 6: (main()+0x27e2) [0x84c462]
  864. 7: (__libc_start_main()+0xf0) [0x7f108b4c7830]
  865. 8: (_start()+0x29) [0x880389]
  866.  
  867. 2020-08-27 14:41:07.008 7f108e316c00 -1 *** Caught signal (Aborted) **
  868. in thread 7f108e316c00 thread_name:ceph-osd
  869.  
  870. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  871. 1: (()+0x11390) [0x7f108bfb1390]
  872. 2: (gsignal()+0x38) [0x7f108b4dc428]
  873. 3: (abort()+0x16a) [0x7f108b4de02a]
  874. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  875. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  876. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  877. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  878. 8: (OSD::init()+0x3f3) [0x8f5483]
  879. 9: (main()+0x27e2) [0x84c462]
  880. 10: (__libc_start_main()+0xf0) [0x7f108b4c7830]
  881. 11: (_start()+0x29) [0x880389]
  882. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  883.  
  884. --- begin dump of recent events ---
  885. -77> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command assert hook 0xbb1a100
  886. -76> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command abort hook 0xbb1a100
  887. -75> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command perfcounters_dump hook 0xbb1a100
  888. -74> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command 1 hook 0xbb1a100
  889. -73> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command perf dump hook 0xbb1a100
  890. -72> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command perfcounters_schema hook 0xbb1a100
  891. -71> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command perf histogram dump hook 0xbb1a100
  892. -70> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command 2 hook 0xbb1a100
  893. -69> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command perf schema hook 0xbb1a100
  894. -68> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command perf histogram schema hook 0xbb1a100
  895. -67> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command perf reset hook 0xbb1a100
  896. -66> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command config show hook 0xbb1a100
  897. -65> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command config help hook 0xbb1a100
  898. -64> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command config set hook 0xbb1a100
  899. -63> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command config unset hook 0xbb1a100
  900. -62> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command config get hook 0xbb1a100
  901. -61> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command config diff hook 0xbb1a100
  902. -60> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command config diff get hook 0xbb1a100
  903. -59> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command log flush hook 0xbb1a100
  904. -58> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command log dump hook 0xbb1a100
  905. -57> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command log reopen hook 0xbb1a100
  906. -56> 2020-08-27 14:41:05.612 7f108e316c00 5 asok(0xbbe0000) register_command dump_mempools hook 0xc7d8068
  907. -55> 2020-08-27 14:41:05.624 7f108e316c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  908. -54> 2020-08-27 14:41:05.624 7f108e316c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3554941
  909. -53> 2020-08-27 14:41:05.624 7f108e316c00 0 pidfile_write: ignore empty --pid-file
  910. -52> 2020-08-27 14:41:05.624 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  911. -51> 2020-08-27 14:41:05.624 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  912. -50> 2020-08-27 14:41:05.624 7f108e316c00 0 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  913. -49> 2020-08-27 14:41:05.624 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  914. -48> 2020-08-27 14:41:05.624 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  915. -47> 2020-08-27 14:41:05.624 7f108e316c00 1 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  916. -46> 2020-08-27 14:41:05.624 7f108e316c00 0 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  917. -45> 2020-08-27 14:41:05.624 7f108e316c00 1 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  918. -44> 2020-08-27 14:41:05.624 7f108e316c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  919. -43> 2020-08-27 14:41:05.628 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  920. -42> 2020-08-27 14:41:05.628 7f108e316c00 1 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  921. -41> 2020-08-27 14:41:05.628 7f108e316c00 0 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  922. -40> 2020-08-27 14:41:05.628 7f108e316c00 1 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  923. -39> 2020-08-27 14:41:05.628 7f108e316c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  924. -38> 2020-08-27 14:41:05.628 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  925. -37> 2020-08-27 14:41:05.628 7f108e316c00 1 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  926. -36> 2020-08-27 14:41:05.628 7f108e316c00 0 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  927. -35> 2020-08-27 14:41:05.628 7f108e316c00 1 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  928. -34> 2020-08-27 14:41:05.628 7f108e316c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  929. -33> 2020-08-27 14:41:05.628 7f108e316c00 1 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  930. -32> 2020-08-27 14:41:05.936 7f108e316c00 1 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block.db) close
  931. -31> 2020-08-27 14:41:06.208 7f108e316c00 1 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block) close
  932. -30> 2020-08-27 14:41:06.440 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) close
  933. -29> 2020-08-27 14:41:06.680 7f108e316c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  934. -28> 2020-08-27 14:41:06.688 7f108e316c00 0 load: jerasure load: lrc load: isa
  935. -27> 2020-08-27 14:41:06.688 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  936. -26> 2020-08-27 14:41:06.688 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  937. -25> 2020-08-27 14:41:06.688 7f108e316c00 0 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  938. -24> 2020-08-27 14:41:06.688 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  939. -23> 2020-08-27 14:41:06.688 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) close
  940. -22> 2020-08-27 14:41:07.000 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  941. -21> 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  942. -20> 2020-08-27 14:41:07.000 7f108e316c00 0 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  943. -19> 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  944. -18> 2020-08-27 14:41:07.000 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  945. -17> 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  946. -16> 2020-08-27 14:41:07.000 7f108e316c00 0 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  947. -15> 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  948. -14> 2020-08-27 14:41:07.000 7f108e316c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  949. -13> 2020-08-27 14:41:07.000 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  950. -12> 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  951. -11> 2020-08-27 14:41:07.000 7f108e316c00 0 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  952. -10> 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  953. -9> 2020-08-27 14:41:07.000 7f108e316c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  954. -8> 2020-08-27 14:41:07.000 7f108e316c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  955. -7> 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  956. -6> 2020-08-27 14:41:07.000 7f108e316c00 0 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  957. -5> 2020-08-27 14:41:07.000 7f108e316c00 1 bdev(0xc8d6a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  958. -4> 2020-08-27 14:41:07.000 7f108e316c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  959. -3> 2020-08-27 14:41:07.000 7f108e316c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  960. -2> 2020-08-27 14:41:07.000 7f108e316c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  961. -1> 2020-08-27 14:41:07.004 7f108e316c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f108e316c00 time 2020-08-27 14:41:07.003977
  962. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  963.  
  964. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  965. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  966. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  967. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  968. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  969. 5: (OSD::init()+0x3f3) [0x8f5483]
  970. 6: (main()+0x27e2) [0x84c462]
  971. 7: (__libc_start_main()+0xf0) [0x7f108b4c7830]
  972. 8: (_start()+0x29) [0x880389]
  973.  
  974. 0> 2020-08-27 14:41:07.008 7f108e316c00 -1 *** Caught signal (Aborted) **
  975. in thread 7f108e316c00 thread_name:ceph-osd
  976.  
  977. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  978. 1: (()+0x11390) [0x7f108bfb1390]
  979. 2: (gsignal()+0x38) [0x7f108b4dc428]
  980. 3: (abort()+0x16a) [0x7f108b4de02a]
  981. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  982. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  983. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  984. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  985. 8: (OSD::init()+0x3f3) [0x8f5483]
  986. 9: (main()+0x27e2) [0x84c462]
  987. 10: (__libc_start_main()+0xf0) [0x7f108b4c7830]
  988. 11: (_start()+0x29) [0x880389]
  989. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  990.  
  991. --- logging levels ---
  992. 0/ 5 none
  993. 0/ 0 lockdep
  994. 0/ 0 context
  995. 0/ 0 crush
  996. 1/ 5 mds
  997. 1/ 5 mds_balancer
  998. 1/ 5 mds_locker
  999. 1/ 5 mds_log
  1000. 1/ 5 mds_log_expire
  1001. 1/ 5 mds_migrator
  1002. 0/ 0 buffer
  1003. 0/ 0 timer
  1004. 0/ 0 filer
  1005. 0/ 1 striper
  1006. 0/ 0 objecter
  1007. 0/ 0 rados
  1008. 0/ 0 rbd
  1009. 0/ 5 rbd_mirror
  1010. 0/ 5 rbd_replay
  1011. 0/ 0 journaler
  1012. 0/ 0 objectcacher
  1013. 0/ 0 client
  1014. 0/ 0 osd
  1015. 0/ 0 optracker
  1016. 0/ 0 objclass
  1017. 0/ 0 filestore
  1018. 0/ 0 journal
  1019. 0/ 0 ms
  1020. 0/ 0 mon
  1021. 0/ 0 monc
  1022. 0/ 0 paxos
  1023. 0/ 0 tp
  1024. 0/ 0 auth
  1025. 1/ 5 crypto
  1026. 0/ 0 finisher
  1027. 1/ 1 reserver
  1028. 0/ 0 heartbeatmap
  1029. 0/ 0 perfcounter
  1030. 0/ 0 rgw
  1031. 1/ 5 rgw_sync
  1032. 1/10 civetweb
  1033. 1/ 5 javaclient
  1034. 0/ 0 asok
  1035. 0/ 0 throttle
  1036. 0/ 0 refs
  1037. 1/ 5 xio
  1038. 1/ 5 compressor
  1039. 0/ 0 bluestore
  1040. 1/ 5 bluefs
  1041. 1/ 3 bdev
  1042. 1/ 5 kstore
  1043. 4/ 5 rocksdb
  1044. 4/ 5 leveldb
  1045. 4/ 5 memdb
  1046. 1/ 5 kinetic
  1047. 1/ 5 fuse
  1048. 1/ 5 mgr
  1049. 1/ 5 mgrc
  1050. 1/ 5 dpdk
  1051. 1/ 5 eventtrace
  1052. 1/ 5 prioritycache
  1053. -2/-2 (syslog threshold)
  1054. -1/-1 (stderr threshold)
  1055. max_recent 10000
  1056. max_new 1000
  1057. log_file /var/log/ceph/ceph-osd.108.log
  1058. --- end dump of recent events ---
  1059. 2020-08-27 14:41:07.704 7f6d36edac00 0 set uid:gid to 64045:64045 (ceph:ceph)
  1060. 2020-08-27 14:41:07.704 7f6d36edac00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3555484
  1061. 2020-08-27 14:41:07.704 7f6d36edac00 0 pidfile_write: ignore empty --pid-file
  1062. 2020-08-27 14:41:07.704 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1063. 2020-08-27 14:41:07.704 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1064. 2020-08-27 14:41:07.704 7f6d36edac00 0 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1065. 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1066. 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1067. 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1068. 2020-08-27 14:41:07.708 7f6d36edac00 0 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1069. 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1070. 2020-08-27 14:41:07.708 7f6d36edac00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1071. 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1072. 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1073. 2020-08-27 14:41:07.708 7f6d36edac00 0 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1074. 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1075. 2020-08-27 14:41:07.708 7f6d36edac00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1076. 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1077. 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1078. 2020-08-27 14:41:07.708 7f6d36edac00 0 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1079. 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1080. 2020-08-27 14:41:07.708 7f6d36edac00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1081. 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.wal) close
  1082. 2020-08-27 14:41:08.052 7f6d36edac00 1 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block.db) close
  1083. 2020-08-27 14:41:08.308 7f6d36edac00 1 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block) close
  1084. 2020-08-27 14:41:08.520 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) close
  1085. 2020-08-27 14:41:08.756 7f6d36edac00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  1086. 2020-08-27 14:41:08.768 7f6d36edac00 0 load: jerasure load: lrc load: isa
  1087. 2020-08-27 14:41:08.768 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1088. 2020-08-27 14:41:08.768 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1089. 2020-08-27 14:41:08.768 7f6d36edac00 0 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1090. 2020-08-27 14:41:08.768 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1091. 2020-08-27 14:41:08.768 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) close
  1092. 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1093. 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1094. 2020-08-27 14:41:09.092 7f6d36edac00 0 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1095. 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1096. 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1097. 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1098. 2020-08-27 14:41:09.092 7f6d36edac00 0 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1099. 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1100. 2020-08-27 14:41:09.092 7f6d36edac00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1101. 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1102. 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1103. 2020-08-27 14:41:09.092 7f6d36edac00 0 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1104. 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1105. 2020-08-27 14:41:09.092 7f6d36edac00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1106. 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1107. 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1108. 2020-08-27 14:41:09.092 7f6d36edac00 0 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1109. 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1110. 2020-08-27 14:41:09.092 7f6d36edac00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1111. 2020-08-27 14:41:09.092 7f6d36edac00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  1112. 2020-08-27 14:41:09.092 7f6d36edac00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  1113. 2020-08-27 14:41:09.096 7f6d36edac00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f6d36edac00 time 2020-08-27 14:41:09.096229
  1114. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  1115.  
  1116. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1117. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  1118. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1119. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1120. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1121. 5: (OSD::init()+0x3f3) [0x8f5483]
  1122. 6: (main()+0x27e2) [0x84c462]
  1123. 7: (__libc_start_main()+0xf0) [0x7f6d3408b830]
  1124. 8: (_start()+0x29) [0x880389]
  1125.  
  1126. 2020-08-27 14:41:09.100 7f6d36edac00 -1 *** Caught signal (Aborted) **
  1127. in thread 7f6d36edac00 thread_name:ceph-osd
  1128.  
  1129. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1130. 1: (()+0x11390) [0x7f6d34b75390]
  1131. 2: (gsignal()+0x38) [0x7f6d340a0428]
  1132. 3: (abort()+0x16a) [0x7f6d340a202a]
  1133. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  1134. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1135. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1136. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1137. 8: (OSD::init()+0x3f3) [0x8f5483]
  1138. 9: (main()+0x27e2) [0x84c462]
  1139. 10: (__libc_start_main()+0xf0) [0x7f6d3408b830]
  1140. 11: (_start()+0x29) [0x880389]
  1141. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  1142.  
  1143. --- begin dump of recent events ---
  1144. -77> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command assert hook 0xb2fe100
  1145. -76> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command abort hook 0xb2fe100
  1146. -75> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command perfcounters_dump hook 0xb2fe100
  1147. -74> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command 1 hook 0xb2fe100
  1148. -73> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command perf dump hook 0xb2fe100
  1149. -72> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command perfcounters_schema hook 0xb2fe100
  1150. -71> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command perf histogram dump hook 0xb2fe100
  1151. -70> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command 2 hook 0xb2fe100
  1152. -69> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command perf schema hook 0xb2fe100
  1153. -68> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command perf histogram schema hook 0xb2fe100
  1154. -67> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command perf reset hook 0xb2fe100
  1155. -66> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command config show hook 0xb2fe100
  1156. -65> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command config help hook 0xb2fe100
  1157. -64> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command config set hook 0xb2fe100
  1158. -63> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command config unset hook 0xb2fe100
  1159. -62> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command config get hook 0xb2fe100
  1160. -61> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command config diff hook 0xb2fe100
  1161. -60> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command config diff get hook 0xb2fe100
  1162. -59> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command log flush hook 0xb2fe100
  1163. -58> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command log dump hook 0xb2fe100
  1164. -57> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command log reopen hook 0xb2fe100
  1165. -56> 2020-08-27 14:41:07.692 7f6d36edac00 5 asok(0xb3c4000) register_command dump_mempools hook 0xbfbc068
  1166. -55> 2020-08-27 14:41:07.704 7f6d36edac00 0 set uid:gid to 64045:64045 (ceph:ceph)
  1167. -54> 2020-08-27 14:41:07.704 7f6d36edac00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3555484
  1168. -53> 2020-08-27 14:41:07.704 7f6d36edac00 0 pidfile_write: ignore empty --pid-file
  1169. -52> 2020-08-27 14:41:07.704 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1170. -51> 2020-08-27 14:41:07.704 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1171. -50> 2020-08-27 14:41:07.704 7f6d36edac00 0 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1172. -49> 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1173. -48> 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1174. -47> 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1175. -46> 2020-08-27 14:41:07.708 7f6d36edac00 0 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1176. -45> 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1177. -44> 2020-08-27 14:41:07.708 7f6d36edac00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1178. -43> 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1179. -42> 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1180. -41> 2020-08-27 14:41:07.708 7f6d36edac00 0 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1181. -40> 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1182. -39> 2020-08-27 14:41:07.708 7f6d36edac00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1183. -38> 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1184. -37> 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1185. -36> 2020-08-27 14:41:07.708 7f6d36edac00 0 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1186. -35> 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1187. -34> 2020-08-27 14:41:07.708 7f6d36edac00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1188. -33> 2020-08-27 14:41:07.708 7f6d36edac00 1 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.wal) close
  1189. -32> 2020-08-27 14:41:08.052 7f6d36edac00 1 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block.db) close
  1190. -31> 2020-08-27 14:41:08.308 7f6d36edac00 1 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block) close
  1191. -30> 2020-08-27 14:41:08.520 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) close
  1192. -29> 2020-08-27 14:41:08.756 7f6d36edac00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  1193. -28> 2020-08-27 14:41:08.768 7f6d36edac00 0 load: jerasure load: lrc load: isa
  1194. -27> 2020-08-27 14:41:08.768 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1195. -26> 2020-08-27 14:41:08.768 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1196. -25> 2020-08-27 14:41:08.768 7f6d36edac00 0 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1197. -24> 2020-08-27 14:41:08.768 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1198. -23> 2020-08-27 14:41:08.768 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) close
  1199. -22> 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1200. -21> 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1201. -20> 2020-08-27 14:41:09.092 7f6d36edac00 0 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1202. -19> 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfee000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1203. -18> 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1204. -17> 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1205. -16> 2020-08-27 14:41:09.092 7f6d36edac00 0 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1206. -15> 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfeee00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1207. -14> 2020-08-27 14:41:09.092 7f6d36edac00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1208. -13> 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1209. -12> 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1210. -11> 2020-08-27 14:41:09.092 7f6d36edac00 0 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1211. -10> 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfee700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1212. -9> 2020-08-27 14:41:09.092 7f6d36edac00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1213. -8> 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1214. -7> 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1215. -6> 2020-08-27 14:41:09.092 7f6d36edac00 0 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1216. -5> 2020-08-27 14:41:09.092 7f6d36edac00 1 bdev(0xbfeea80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1217. -4> 2020-08-27 14:41:09.092 7f6d36edac00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1218. -3> 2020-08-27 14:41:09.092 7f6d36edac00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  1219. -2> 2020-08-27 14:41:09.092 7f6d36edac00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  1220. -1> 2020-08-27 14:41:09.096 7f6d36edac00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f6d36edac00 time 2020-08-27 14:41:09.096229
  1221. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  1222.  
  1223. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1224. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  1225. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1226. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1227. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1228. 5: (OSD::init()+0x3f3) [0x8f5483]
  1229. 6: (main()+0x27e2) [0x84c462]
  1230. 7: (__libc_start_main()+0xf0) [0x7f6d3408b830]
  1231. 8: (_start()+0x29) [0x880389]
  1232.  
  1233. 0> 2020-08-27 14:41:09.100 7f6d36edac00 -1 *** Caught signal (Aborted) **
  1234. in thread 7f6d36edac00 thread_name:ceph-osd
  1235.  
  1236. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1237. 1: (()+0x11390) [0x7f6d34b75390]
  1238. 2: (gsignal()+0x38) [0x7f6d340a0428]
  1239. 3: (abort()+0x16a) [0x7f6d340a202a]
  1240. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  1241. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1242. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1243. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1244. 8: (OSD::init()+0x3f3) [0x8f5483]
  1245. 9: (main()+0x27e2) [0x84c462]
  1246. 10: (__libc_start_main()+0xf0) [0x7f6d3408b830]
  1247. 11: (_start()+0x29) [0x880389]
  1248. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  1249.  
  1250. --- logging levels ---
  1251. 0/ 5 none
  1252. 0/ 0 lockdep
  1253. 0/ 0 context
  1254. 0/ 0 crush
  1255. 1/ 5 mds
  1256. 1/ 5 mds_balancer
  1257. 1/ 5 mds_locker
  1258. 1/ 5 mds_log
  1259. 1/ 5 mds_log_expire
  1260. 1/ 5 mds_migrator
  1261. 0/ 0 buffer
  1262. 0/ 0 timer
  1263. 0/ 0 filer
  1264. 0/ 1 striper
  1265. 0/ 0 objecter
  1266. 0/ 0 rados
  1267. 0/ 0 rbd
  1268. 0/ 5 rbd_mirror
  1269. 0/ 5 rbd_replay
  1270. 0/ 0 journaler
  1271. 0/ 0 objectcacher
  1272. 0/ 0 client
  1273. 0/ 0 osd
  1274. 0/ 0 optracker
  1275. 0/ 0 objclass
  1276. 0/ 0 filestore
  1277. 0/ 0 journal
  1278. 0/ 0 ms
  1279. 0/ 0 mon
  1280. 0/ 0 monc
  1281. 0/ 0 paxos
  1282. 0/ 0 tp
  1283. 0/ 0 auth
  1284. 1/ 5 crypto
  1285. 0/ 0 finisher
  1286. 1/ 1 reserver
  1287. 0/ 0 heartbeatmap
  1288. 0/ 0 perfcounter
  1289. 0/ 0 rgw
  1290. 1/ 5 rgw_sync
  1291. 1/10 civetweb
  1292. 1/ 5 javaclient
  1293. 0/ 0 asok
  1294. 0/ 0 throttle
  1295. 0/ 0 refs
  1296. 1/ 5 xio
  1297. 1/ 5 compressor
  1298. 0/ 0 bluestore
  1299. 1/ 5 bluefs
  1300. 1/ 3 bdev
  1301. 1/ 5 kstore
  1302. 4/ 5 rocksdb
  1303. 4/ 5 leveldb
  1304. 4/ 5 memdb
  1305. 1/ 5 kinetic
  1306. 1/ 5 fuse
  1307. 1/ 5 mgr
  1308. 1/ 5 mgrc
  1309. 1/ 5 dpdk
  1310. 1/ 5 eventtrace
  1311. 1/ 5 prioritycache
  1312. -2/-2 (syslog threshold)
  1313. -1/-1 (stderr threshold)
  1314. max_recent 10000
  1315. max_new 1000
  1316. log_file /var/log/ceph/ceph-osd.108.log
  1317. --- end dump of recent events ---
  1318. 2020-08-27 14:41:09.700 7f7b11c84c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  1319. 2020-08-27 14:41:09.700 7f7b11c84c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3556220
  1320. 2020-08-27 14:41:09.700 7f7b11c84c00 0 pidfile_write: ignore empty --pid-file
  1321. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1322. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1323. 2020-08-27 14:41:09.704 7f7b11c84c00 0 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1324. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1325. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1326. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1327. 2020-08-27 14:41:09.704 7f7b11c84c00 0 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1328. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1329. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1330. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1331. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1332. 2020-08-27 14:41:09.704 7f7b11c84c00 0 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1333. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1334. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1335. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1336. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1337. 2020-08-27 14:41:09.704 7f7b11c84c00 0 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1338. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1339. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1340. 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  1341. 2020-08-27 14:41:10.020 7f7b11c84c00 1 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block.db) close
  1342. 2020-08-27 14:41:10.300 7f7b11c84c00 1 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block) close
  1343. 2020-08-27 14:41:10.500 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) close
  1344. 2020-08-27 14:41:10.756 7f7b11c84c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  1345. 2020-08-27 14:41:10.768 7f7b11c84c00 0 load: jerasure load: lrc load: isa
  1346. 2020-08-27 14:41:10.768 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1347. 2020-08-27 14:41:10.768 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1348. 2020-08-27 14:41:10.768 7f7b11c84c00 0 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1349. 2020-08-27 14:41:10.768 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1350. 2020-08-27 14:41:10.768 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) close
  1351. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1352. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1353. 2020-08-27 14:41:11.088 7f7b11c84c00 0 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1354. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1355. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1356. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1357. 2020-08-27 14:41:11.088 7f7b11c84c00 0 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1358. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1359. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1360. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1361. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1362. 2020-08-27 14:41:11.088 7f7b11c84c00 0 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1363. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1364. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1365. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1366. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1367. 2020-08-27 14:41:11.088 7f7b11c84c00 0 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1368. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1369. 2020-08-27 14:41:11.088 7f7b11c84c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1370. 2020-08-27 14:41:11.088 7f7b11c84c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  1371. 2020-08-27 14:41:11.088 7f7b11c84c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  1372. 2020-08-27 14:41:11.092 7f7b11c84c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f7b11c84c00 time 2020-08-27 14:41:11.091929
  1373. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  1374.  
  1375. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1376. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  1377. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1378. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1379. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1380. 5: (OSD::init()+0x3f3) [0x8f5483]
  1381. 6: (main()+0x27e2) [0x84c462]
  1382. 7: (__libc_start_main()+0xf0) [0x7f7b0ee35830]
  1383. 8: (_start()+0x29) [0x880389]
  1384.  
  1385. 2020-08-27 14:41:11.096 7f7b11c84c00 -1 *** Caught signal (Aborted) **
  1386. in thread 7f7b11c84c00 thread_name:ceph-osd
  1387.  
  1388. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1389. 1: (()+0x11390) [0x7f7b0f91f390]
  1390. 2: (gsignal()+0x38) [0x7f7b0ee4a428]
  1391. 3: (abort()+0x16a) [0x7f7b0ee4c02a]
  1392. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  1393. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1394. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1395. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1396. 8: (OSD::init()+0x3f3) [0x8f5483]
  1397. 9: (main()+0x27e2) [0x84c462]
  1398. 10: (__libc_start_main()+0xf0) [0x7f7b0ee35830]
  1399. 11: (_start()+0x29) [0x880389]
  1400. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  1401.  
  1402. --- begin dump of recent events ---
  1403. -77> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command assert hook 0xaca8100
  1404. -76> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command abort hook 0xaca8100
  1405. -75> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command perfcounters_dump hook 0xaca8100
  1406. -74> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command 1 hook 0xaca8100
  1407. -73> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command perf dump hook 0xaca8100
  1408. -72> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command perfcounters_schema hook 0xaca8100
  1409. -71> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command perf histogram dump hook 0xaca8100
  1410. -70> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command 2 hook 0xaca8100
  1411. -69> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command perf schema hook 0xaca8100
  1412. -68> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command perf histogram schema hook 0xaca8100
  1413. -67> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command perf reset hook 0xaca8100
  1414. -66> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command config show hook 0xaca8100
  1415. -65> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command config help hook 0xaca8100
  1416. -64> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command config set hook 0xaca8100
  1417. -63> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command config unset hook 0xaca8100
  1418. -62> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command config get hook 0xaca8100
  1419. -61> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command config diff hook 0xaca8100
  1420. -60> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command config diff get hook 0xaca8100
  1421. -59> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command log flush hook 0xaca8100
  1422. -58> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command log dump hook 0xaca8100
  1423. -57> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command log reopen hook 0xaca8100
  1424. -56> 2020-08-27 14:41:09.688 7f7b11c84c00 5 asok(0xad6e000) register_command dump_mempools hook 0xb966068
  1425. -55> 2020-08-27 14:41:09.700 7f7b11c84c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  1426. -54> 2020-08-27 14:41:09.700 7f7b11c84c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3556220
  1427. -53> 2020-08-27 14:41:09.700 7f7b11c84c00 0 pidfile_write: ignore empty --pid-file
  1428. -52> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1429. -51> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1430. -50> 2020-08-27 14:41:09.704 7f7b11c84c00 0 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1431. -49> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1432. -48> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1433. -47> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1434. -46> 2020-08-27 14:41:09.704 7f7b11c84c00 0 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1435. -45> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1436. -44> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1437. -43> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1438. -42> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1439. -41> 2020-08-27 14:41:09.704 7f7b11c84c00 0 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1440. -40> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1441. -39> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1442. -38> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1443. -37> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1444. -36> 2020-08-27 14:41:09.704 7f7b11c84c00 0 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1445. -35> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1446. -34> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1447. -33> 2020-08-27 14:41:09.704 7f7b11c84c00 1 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  1448. -32> 2020-08-27 14:41:10.020 7f7b11c84c00 1 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block.db) close
  1449. -31> 2020-08-27 14:41:10.300 7f7b11c84c00 1 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block) close
  1450. -30> 2020-08-27 14:41:10.500 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) close
  1451. -29> 2020-08-27 14:41:10.756 7f7b11c84c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  1452. -28> 2020-08-27 14:41:10.768 7f7b11c84c00 0 load: jerasure load: lrc load: isa
  1453. -27> 2020-08-27 14:41:10.768 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1454. -26> 2020-08-27 14:41:10.768 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1455. -25> 2020-08-27 14:41:10.768 7f7b11c84c00 0 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1456. -24> 2020-08-27 14:41:10.768 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1457. -23> 2020-08-27 14:41:10.768 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) close
  1458. -22> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1459. -21> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1460. -20> 2020-08-27 14:41:11.088 7f7b11c84c00 0 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1461. -19> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1462. -18> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1463. -17> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1464. -16> 2020-08-27 14:41:11.088 7f7b11c84c00 0 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1465. -15> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1466. -14> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1467. -13> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1468. -12> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1469. -11> 2020-08-27 14:41:11.088 7f7b11c84c00 0 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1470. -10> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1471. -9> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1472. -8> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1473. -7> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1474. -6> 2020-08-27 14:41:11.088 7f7b11c84c00 0 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1475. -5> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bdev(0xb998a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1476. -4> 2020-08-27 14:41:11.088 7f7b11c84c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1477. -3> 2020-08-27 14:41:11.088 7f7b11c84c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  1478. -2> 2020-08-27 14:41:11.088 7f7b11c84c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  1479. -1> 2020-08-27 14:41:11.092 7f7b11c84c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f7b11c84c00 time 2020-08-27 14:41:11.091929
  1480. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  1481.  
  1482. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1483. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  1484. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1485. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1486. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1487. 5: (OSD::init()+0x3f3) [0x8f5483]
  1488. 6: (main()+0x27e2) [0x84c462]
  1489. 7: (__libc_start_main()+0xf0) [0x7f7b0ee35830]
  1490. 8: (_start()+0x29) [0x880389]
  1491.  
  1492. 0> 2020-08-27 14:41:11.096 7f7b11c84c00 -1 *** Caught signal (Aborted) **
  1493. in thread 7f7b11c84c00 thread_name:ceph-osd
  1494.  
  1495. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1496. 1: (()+0x11390) [0x7f7b0f91f390]
  1497. 2: (gsignal()+0x38) [0x7f7b0ee4a428]
  1498. 3: (abort()+0x16a) [0x7f7b0ee4c02a]
  1499. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  1500. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1501. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1502. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1503. 8: (OSD::init()+0x3f3) [0x8f5483]
  1504. 9: (main()+0x27e2) [0x84c462]
  1505. 10: (__libc_start_main()+0xf0) [0x7f7b0ee35830]
  1506. 11: (_start()+0x29) [0x880389]
  1507. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  1508.  
  1509. --- logging levels ---
  1510. 0/ 5 none
  1511. 0/ 0 lockdep
  1512. 0/ 0 context
  1513. 0/ 0 crush
  1514. 1/ 5 mds
  1515. 1/ 5 mds_balancer
  1516. 1/ 5 mds_locker
  1517. 1/ 5 mds_log
  1518. 1/ 5 mds_log_expire
  1519. 1/ 5 mds_migrator
  1520. 0/ 0 buffer
  1521. 0/ 0 timer
  1522. 0/ 0 filer
  1523. 0/ 1 striper
  1524. 0/ 0 objecter
  1525. 0/ 0 rados
  1526. 0/ 0 rbd
  1527. 0/ 5 rbd_mirror
  1528. 0/ 5 rbd_replay
  1529. 0/ 0 journaler
  1530. 0/ 0 objectcacher
  1531. 0/ 0 client
  1532. 0/ 0 osd
  1533. 0/ 0 optracker
  1534. 0/ 0 objclass
  1535. 0/ 0 filestore
  1536. 0/ 0 journal
  1537. 0/ 0 ms
  1538. 0/ 0 mon
  1539. 0/ 0 monc
  1540. 0/ 0 paxos
  1541. 0/ 0 tp
  1542. 0/ 0 auth
  1543. 1/ 5 crypto
  1544. 0/ 0 finisher
  1545. 1/ 1 reserver
  1546. 0/ 0 heartbeatmap
  1547. 0/ 0 perfcounter
  1548. 0/ 0 rgw
  1549. 1/ 5 rgw_sync
  1550. 1/10 civetweb
  1551. 1/ 5 javaclient
  1552. 0/ 0 asok
  1553. 0/ 0 throttle
  1554. 0/ 0 refs
  1555. 1/ 5 xio
  1556. 1/ 5 compressor
  1557. 0/ 0 bluestore
  1558. 1/ 5 bluefs
  1559. 1/ 3 bdev
  1560. 1/ 5 kstore
  1561. 4/ 5 rocksdb
  1562. 4/ 5 leveldb
  1563. 4/ 5 memdb
  1564. 1/ 5 kinetic
  1565. 1/ 5 fuse
  1566. 1/ 5 mgr
  1567. 1/ 5 mgrc
  1568. 1/ 5 dpdk
  1569. 1/ 5 eventtrace
  1570. 1/ 5 prioritycache
  1571. -2/-2 (syslog threshold)
  1572. -1/-1 (stderr threshold)
  1573. max_recent 10000
  1574. max_new 1000
  1575. log_file /var/log/ceph/ceph-osd.108.log
  1576. --- end dump of recent events ---
  1577. 2020-08-27 14:41:11.672 7f9287645c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  1578. 2020-08-27 14:41:11.676 7f9287645c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3556849
  1579. 2020-08-27 14:41:11.676 7f9287645c00 0 pidfile_write: ignore empty --pid-file
  1580. 2020-08-27 14:41:11.676 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1581. 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1582. 2020-08-27 14:41:11.676 7f9287645c00 0 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1583. 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1584. 2020-08-27 14:41:11.676 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1585. 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1586. 2020-08-27 14:41:11.676 7f9287645c00 0 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1587. 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1588. 2020-08-27 14:41:11.676 7f9287645c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1589. 2020-08-27 14:41:11.676 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1590. 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1591. 2020-08-27 14:41:11.676 7f9287645c00 0 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1592. 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1593. 2020-08-27 14:41:11.676 7f9287645c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1594. 2020-08-27 14:41:11.676 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1595. 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1596. 2020-08-27 14:41:11.676 7f9287645c00 0 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1597. 2020-08-27 14:41:11.680 7f9287645c00 1 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1598. 2020-08-27 14:41:11.680 7f9287645c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1599. 2020-08-27 14:41:11.680 7f9287645c00 1 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  1600. 2020-08-27 14:41:11.996 7f9287645c00 1 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block.db) close
  1601. 2020-08-27 14:41:12.264 7f9287645c00 1 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block) close
  1602. 2020-08-27 14:41:12.516 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) close
  1603. 2020-08-27 14:41:12.716 7f9287645c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  1604. 2020-08-27 14:41:12.724 7f9287645c00 0 load: jerasure load: lrc load: isa
  1605. 2020-08-27 14:41:12.724 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1606. 2020-08-27 14:41:12.724 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1607. 2020-08-27 14:41:12.724 7f9287645c00 0 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1608. 2020-08-27 14:41:12.724 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1609. 2020-08-27 14:41:12.724 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) close
  1610. 2020-08-27 14:41:13.052 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1611. 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1612. 2020-08-27 14:41:13.052 7f9287645c00 0 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1613. 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1614. 2020-08-27 14:41:13.052 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1615. 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1616. 2020-08-27 14:41:13.052 7f9287645c00 0 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1617. 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1618. 2020-08-27 14:41:13.052 7f9287645c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1619. 2020-08-27 14:41:13.052 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1620. 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1621. 2020-08-27 14:41:13.052 7f9287645c00 0 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1622. 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1623. 2020-08-27 14:41:13.052 7f9287645c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1624. 2020-08-27 14:41:13.052 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1625. 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1626. 2020-08-27 14:41:13.052 7f9287645c00 0 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1627. 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1628. 2020-08-27 14:41:13.052 7f9287645c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1629. 2020-08-27 14:41:13.052 7f9287645c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  1630. 2020-08-27 14:41:13.052 7f9287645c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  1631. 2020-08-27 14:41:13.056 7f9287645c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f9287645c00 time 2020-08-27 14:41:13.056056
  1632. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  1633.  
  1634. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1635. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  1636. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1637. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1638. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1639. 5: (OSD::init()+0x3f3) [0x8f5483]
  1640. 6: (main()+0x27e2) [0x84c462]
  1641. 7: (__libc_start_main()+0xf0) [0x7f92847f6830]
  1642. 8: (_start()+0x29) [0x880389]
  1643.  
  1644. 2020-08-27 14:41:13.060 7f9287645c00 -1 *** Caught signal (Aborted) **
  1645. in thread 7f9287645c00 thread_name:ceph-osd
  1646.  
  1647. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1648. 1: (()+0x11390) [0x7f92852e0390]
  1649. 2: (gsignal()+0x38) [0x7f928480b428]
  1650. 3: (abort()+0x16a) [0x7f928480d02a]
  1651. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  1652. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1653. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1654. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1655. 8: (OSD::init()+0x3f3) [0x8f5483]
  1656. 9: (main()+0x27e2) [0x84c462]
  1657. 10: (__libc_start_main()+0xf0) [0x7f92847f6830]
  1658. 11: (_start()+0x29) [0x880389]
  1659. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  1660.  
  1661. --- begin dump of recent events ---
  1662. -77> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command assert hook 0xb85c100
  1663. -76> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command abort hook 0xb85c100
  1664. -75> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command perfcounters_dump hook 0xb85c100
  1665. -74> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command 1 hook 0xb85c100
  1666. -73> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command perf dump hook 0xb85c100
  1667. -72> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command perfcounters_schema hook 0xb85c100
  1668. -71> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command perf histogram dump hook 0xb85c100
  1669. -70> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command 2 hook 0xb85c100
  1670. -69> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command perf schema hook 0xb85c100
  1671. -68> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command perf histogram schema hook 0xb85c100
  1672. -67> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command perf reset hook 0xb85c100
  1673. -66> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command config show hook 0xb85c100
  1674. -65> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command config help hook 0xb85c100
  1675. -64> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command config set hook 0xb85c100
  1676. -63> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command config unset hook 0xb85c100
  1677. -62> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command config get hook 0xb85c100
  1678. -61> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command config diff hook 0xb85c100
  1679. -60> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command config diff get hook 0xb85c100
  1680. -59> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command log flush hook 0xb85c100
  1681. -58> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command log dump hook 0xb85c100
  1682. -57> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command log reopen hook 0xb85c100
  1683. -56> 2020-08-27 14:41:11.664 7f9287645c00 5 asok(0xb922000) register_command dump_mempools hook 0xc51a068
  1684. -55> 2020-08-27 14:41:11.672 7f9287645c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  1685. -54> 2020-08-27 14:41:11.676 7f9287645c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3556849
  1686. -53> 2020-08-27 14:41:11.676 7f9287645c00 0 pidfile_write: ignore empty --pid-file
  1687. -52> 2020-08-27 14:41:11.676 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1688. -51> 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1689. -50> 2020-08-27 14:41:11.676 7f9287645c00 0 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1690. -49> 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1691. -48> 2020-08-27 14:41:11.676 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1692. -47> 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1693. -46> 2020-08-27 14:41:11.676 7f9287645c00 0 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1694. -45> 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1695. -44> 2020-08-27 14:41:11.676 7f9287645c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1696. -43> 2020-08-27 14:41:11.676 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1697. -42> 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1698. -41> 2020-08-27 14:41:11.676 7f9287645c00 0 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1699. -40> 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1700. -39> 2020-08-27 14:41:11.676 7f9287645c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1701. -38> 2020-08-27 14:41:11.676 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1702. -37> 2020-08-27 14:41:11.676 7f9287645c00 1 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1703. -36> 2020-08-27 14:41:11.676 7f9287645c00 0 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1704. -35> 2020-08-27 14:41:11.680 7f9287645c00 1 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1705. -34> 2020-08-27 14:41:11.680 7f9287645c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1706. -33> 2020-08-27 14:41:11.680 7f9287645c00 1 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  1707. -32> 2020-08-27 14:41:11.996 7f9287645c00 1 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block.db) close
  1708. -31> 2020-08-27 14:41:12.264 7f9287645c00 1 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block) close
  1709. -30> 2020-08-27 14:41:12.516 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) close
  1710. -29> 2020-08-27 14:41:12.716 7f9287645c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  1711. -28> 2020-08-27 14:41:12.724 7f9287645c00 0 load: jerasure load: lrc load: isa
  1712. -27> 2020-08-27 14:41:12.724 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1713. -26> 2020-08-27 14:41:12.724 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1714. -25> 2020-08-27 14:41:12.724 7f9287645c00 0 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1715. -24> 2020-08-27 14:41:12.724 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1716. -23> 2020-08-27 14:41:12.724 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) close
  1717. -22> 2020-08-27 14:41:13.052 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1718. -21> 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1719. -20> 2020-08-27 14:41:13.052 7f9287645c00 0 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1720. -19> 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1721. -18> 2020-08-27 14:41:13.052 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1722. -17> 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1723. -16> 2020-08-27 14:41:13.052 7f9287645c00 0 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1724. -15> 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1725. -14> 2020-08-27 14:41:13.052 7f9287645c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1726. -13> 2020-08-27 14:41:13.052 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1727. -12> 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1728. -11> 2020-08-27 14:41:13.052 7f9287645c00 0 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1729. -10> 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1730. -9> 2020-08-27 14:41:13.052 7f9287645c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1731. -8> 2020-08-27 14:41:13.052 7f9287645c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1732. -7> 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1733. -6> 2020-08-27 14:41:13.052 7f9287645c00 0 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1734. -5> 2020-08-27 14:41:13.052 7f9287645c00 1 bdev(0xc618a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1735. -4> 2020-08-27 14:41:13.052 7f9287645c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1736. -3> 2020-08-27 14:41:13.052 7f9287645c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  1737. -2> 2020-08-27 14:41:13.052 7f9287645c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  1738. -1> 2020-08-27 14:41:13.056 7f9287645c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f9287645c00 time 2020-08-27 14:41:13.056056
  1739. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  1740.  
  1741. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1742. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  1743. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1744. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1745. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1746. 5: (OSD::init()+0x3f3) [0x8f5483]
  1747. 6: (main()+0x27e2) [0x84c462]
  1748. 7: (__libc_start_main()+0xf0) [0x7f92847f6830]
  1749. 8: (_start()+0x29) [0x880389]
  1750.  
  1751. 0> 2020-08-27 14:41:13.060 7f9287645c00 -1 *** Caught signal (Aborted) **
  1752. in thread 7f9287645c00 thread_name:ceph-osd
  1753.  
  1754. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1755. 1: (()+0x11390) [0x7f92852e0390]
  1756. 2: (gsignal()+0x38) [0x7f928480b428]
  1757. 3: (abort()+0x16a) [0x7f928480d02a]
  1758. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  1759. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1760. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1761. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1762. 8: (OSD::init()+0x3f3) [0x8f5483]
  1763. 9: (main()+0x27e2) [0x84c462]
  1764. 10: (__libc_start_main()+0xf0) [0x7f92847f6830]
  1765. 11: (_start()+0x29) [0x880389]
  1766. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  1767.  
  1768. --- logging levels ---
  1769. 0/ 5 none
  1770. 0/ 0 lockdep
  1771. 0/ 0 context
  1772. 0/ 0 crush
  1773. 1/ 5 mds
  1774. 1/ 5 mds_balancer
  1775. 1/ 5 mds_locker
  1776. 1/ 5 mds_log
  1777. 1/ 5 mds_log_expire
  1778. 1/ 5 mds_migrator
  1779. 0/ 0 buffer
  1780. 0/ 0 timer
  1781. 0/ 0 filer
  1782. 0/ 1 striper
  1783. 0/ 0 objecter
  1784. 0/ 0 rados
  1785. 0/ 0 rbd
  1786. 0/ 5 rbd_mirror
  1787. 0/ 5 rbd_replay
  1788. 0/ 0 journaler
  1789. 0/ 0 objectcacher
  1790. 0/ 0 client
  1791. 0/ 0 osd
  1792. 0/ 0 optracker
  1793. 0/ 0 objclass
  1794. 0/ 0 filestore
  1795. 0/ 0 journal
  1796. 0/ 0 ms
  1797. 0/ 0 mon
  1798. 0/ 0 monc
  1799. 0/ 0 paxos
  1800. 0/ 0 tp
  1801. 0/ 0 auth
  1802. 1/ 5 crypto
  1803. 0/ 0 finisher
  1804. 1/ 1 reserver
  1805. 0/ 0 heartbeatmap
  1806. 0/ 0 perfcounter
  1807. 0/ 0 rgw
  1808. 1/ 5 rgw_sync
  1809. 1/10 civetweb
  1810. 1/ 5 javaclient
  1811. 0/ 0 asok
  1812. 0/ 0 throttle
  1813. 0/ 0 refs
  1814. 1/ 5 xio
  1815. 1/ 5 compressor
  1816. 0/ 0 bluestore
  1817. 1/ 5 bluefs
  1818. 1/ 3 bdev
  1819. 1/ 5 kstore
  1820. 4/ 5 rocksdb
  1821. 4/ 5 leveldb
  1822. 4/ 5 memdb
  1823. 1/ 5 kinetic
  1824. 1/ 5 fuse
  1825. 1/ 5 mgr
  1826. 1/ 5 mgrc
  1827. 1/ 5 dpdk
  1828. 1/ 5 eventtrace
  1829. 1/ 5 prioritycache
  1830. -2/-2 (syslog threshold)
  1831. -1/-1 (stderr threshold)
  1832. max_recent 10000
  1833. max_new 1000
  1834. log_file /var/log/ceph/ceph-osd.108.log
  1835. --- end dump of recent events ---
  1836. 2020-08-27 14:41:13.624 7f16cdf8ec00 0 set uid:gid to 64045:64045 (ceph:ceph)
  1837. 2020-08-27 14:41:13.624 7f16cdf8ec00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3557546
  1838. 2020-08-27 14:41:13.624 7f16cdf8ec00 0 pidfile_write: ignore empty --pid-file
  1839. 2020-08-27 14:41:13.624 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1840. 2020-08-27 14:41:13.624 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1841. 2020-08-27 14:41:13.624 7f16cdf8ec00 0 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1842. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1843. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1844. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1845. 2020-08-27 14:41:13.628 7f16cdf8ec00 0 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1846. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1847. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1848. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1849. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1850. 2020-08-27 14:41:13.628 7f16cdf8ec00 0 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1851. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1852. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1853. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1854. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1855. 2020-08-27 14:41:13.628 7f16cdf8ec00 0 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1856. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1857. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1858. 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.wal) close
  1859. 2020-08-27 14:41:13.984 7f16cdf8ec00 1 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block.db) close
  1860. 2020-08-27 14:41:14.212 7f16cdf8ec00 1 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block) close
  1861. 2020-08-27 14:41:14.424 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) close
  1862. 2020-08-27 14:41:14.728 7f16cdf8ec00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  1863. 2020-08-27 14:41:14.736 7f16cdf8ec00 0 load: jerasure load: lrc load: isa
  1864. 2020-08-27 14:41:14.736 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1865. 2020-08-27 14:41:14.736 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1866. 2020-08-27 14:41:14.736 7f16cdf8ec00 0 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1867. 2020-08-27 14:41:14.736 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1868. 2020-08-27 14:41:14.736 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) close
  1869. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1870. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1871. 2020-08-27 14:41:15.044 7f16cdf8ec00 0 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1872. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1873. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1874. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1875. 2020-08-27 14:41:15.044 7f16cdf8ec00 0 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1876. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1877. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1878. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1879. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1880. 2020-08-27 14:41:15.044 7f16cdf8ec00 0 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1881. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1882. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1883. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1884. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1885. 2020-08-27 14:41:15.044 7f16cdf8ec00 0 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1886. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1887. 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1888. 2020-08-27 14:41:15.044 7f16cdf8ec00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  1889. 2020-08-27 14:41:15.044 7f16cdf8ec00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  1890. 2020-08-27 14:41:15.048 7f16cdf8ec00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f16cdf8ec00 time 2020-08-27 14:41:15.047446
  1891. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  1892.  
  1893. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1894. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  1895. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1896. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1897. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1898. 5: (OSD::init()+0x3f3) [0x8f5483]
  1899. 6: (main()+0x27e2) [0x84c462]
  1900. 7: (__libc_start_main()+0xf0) [0x7f16cb13f830]
  1901. 8: (_start()+0x29) [0x880389]
  1902.  
  1903. 2020-08-27 14:41:15.048 7f16cdf8ec00 -1 *** Caught signal (Aborted) **
  1904. in thread 7f16cdf8ec00 thread_name:ceph-osd
  1905.  
  1906. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  1907. 1: (()+0x11390) [0x7f16cbc29390]
  1908. 2: (gsignal()+0x38) [0x7f16cb154428]
  1909. 3: (abort()+0x16a) [0x7f16cb15602a]
  1910. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  1911. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  1912. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  1913. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  1914. 8: (OSD::init()+0x3f3) [0x8f5483]
  1915. 9: (main()+0x27e2) [0x84c462]
  1916. 10: (__libc_start_main()+0xf0) [0x7f16cb13f830]
  1917. 11: (_start()+0x29) [0x880389]
  1918. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  1919.  
  1920. --- begin dump of recent events ---
  1921. -77> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command assert hook 0xbf0e100
  1922. -76> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command abort hook 0xbf0e100
  1923. -75> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command perfcounters_dump hook 0xbf0e100
  1924. -74> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command 1 hook 0xbf0e100
  1925. -73> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command perf dump hook 0xbf0e100
  1926. -72> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command perfcounters_schema hook 0xbf0e100
  1927. -71> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command perf histogram dump hook 0xbf0e100
  1928. -70> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command 2 hook 0xbf0e100
  1929. -69> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command perf schema hook 0xbf0e100
  1930. -68> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command perf histogram schema hook 0xbf0e100
  1931. -67> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command perf reset hook 0xbf0e100
  1932. -66> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command config show hook 0xbf0e100
  1933. -65> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command config help hook 0xbf0e100
  1934. -64> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command config set hook 0xbf0e100
  1935. -63> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command config unset hook 0xbf0e100
  1936. -62> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command config get hook 0xbf0e100
  1937. -61> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command config diff hook 0xbf0e100
  1938. -60> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command config diff get hook 0xbf0e100
  1939. -59> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command log flush hook 0xbf0e100
  1940. -58> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command log dump hook 0xbf0e100
  1941. -57> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command log reopen hook 0xbf0e100
  1942. -56> 2020-08-27 14:41:13.612 7f16cdf8ec00 5 asok(0xbfd4000) register_command dump_mempools hook 0xcbcc068
  1943. -55> 2020-08-27 14:41:13.624 7f16cdf8ec00 0 set uid:gid to 64045:64045 (ceph:ceph)
  1944. -54> 2020-08-27 14:41:13.624 7f16cdf8ec00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3557546
  1945. -53> 2020-08-27 14:41:13.624 7f16cdf8ec00 0 pidfile_write: ignore empty --pid-file
  1946. -52> 2020-08-27 14:41:13.624 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1947. -51> 2020-08-27 14:41:13.624 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1948. -50> 2020-08-27 14:41:13.624 7f16cdf8ec00 0 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1949. -49> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1950. -48> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1951. -47> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1952. -46> 2020-08-27 14:41:13.628 7f16cdf8ec00 0 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1953. -45> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1954. -44> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1955. -43> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1956. -42> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1957. -41> 2020-08-27 14:41:13.628 7f16cdf8ec00 0 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1958. -40> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1959. -39> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1960. -38> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1961. -37> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1962. -36> 2020-08-27 14:41:13.628 7f16cdf8ec00 0 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1963. -35> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1964. -34> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1965. -33> 2020-08-27 14:41:13.628 7f16cdf8ec00 1 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.wal) close
  1966. -32> 2020-08-27 14:41:13.984 7f16cdf8ec00 1 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block.db) close
  1967. -31> 2020-08-27 14:41:14.212 7f16cdf8ec00 1 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block) close
  1968. -30> 2020-08-27 14:41:14.424 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) close
  1969. -29> 2020-08-27 14:41:14.728 7f16cdf8ec00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  1970. -28> 2020-08-27 14:41:14.736 7f16cdf8ec00 0 load: jerasure load: lrc load: isa
  1971. -27> 2020-08-27 14:41:14.736 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1972. -26> 2020-08-27 14:41:14.736 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1973. -25> 2020-08-27 14:41:14.736 7f16cdf8ec00 0 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1974. -24> 2020-08-27 14:41:14.736 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1975. -23> 2020-08-27 14:41:14.736 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) close
  1976. -22> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1977. -21> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1978. -20> 2020-08-27 14:41:15.044 7f16cdf8ec00 0 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1979. -19> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xccca000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1980. -18> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  1981. -17> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  1982. -16> 2020-08-27 14:41:15.044 7f16cdf8ec00 0 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  1983. -15> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xcccae00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1984. -14> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  1985. -13> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  1986. -12> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  1987. -11> 2020-08-27 14:41:15.044 7f16cdf8ec00 0 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  1988. -10> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xccca700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1989. -9> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  1990. -8> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  1991. -7> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  1992. -6> 2020-08-27 14:41:15.044 7f16cdf8ec00 0 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  1993. -5> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bdev(0xcccaa80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1994. -4> 2020-08-27 14:41:15.044 7f16cdf8ec00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  1995. -3> 2020-08-27 14:41:15.044 7f16cdf8ec00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  1996. -2> 2020-08-27 14:41:15.044 7f16cdf8ec00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  1997. -1> 2020-08-27 14:41:15.048 7f16cdf8ec00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f16cdf8ec00 time 2020-08-27 14:41:15.047446
  1998. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  1999.  
  2000. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2001. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  2002. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2003. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2004. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2005. 5: (OSD::init()+0x3f3) [0x8f5483]
  2006. 6: (main()+0x27e2) [0x84c462]
  2007. 7: (__libc_start_main()+0xf0) [0x7f16cb13f830]
  2008. 8: (_start()+0x29) [0x880389]
  2009.  
  2010. 0> 2020-08-27 14:41:15.048 7f16cdf8ec00 -1 *** Caught signal (Aborted) **
  2011. in thread 7f16cdf8ec00 thread_name:ceph-osd
  2012.  
  2013. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2014. 1: (()+0x11390) [0x7f16cbc29390]
  2015. 2: (gsignal()+0x38) [0x7f16cb154428]
  2016. 3: (abort()+0x16a) [0x7f16cb15602a]
  2017. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  2018. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2019. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2020. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2021. 8: (OSD::init()+0x3f3) [0x8f5483]
  2022. 9: (main()+0x27e2) [0x84c462]
  2023. 10: (__libc_start_main()+0xf0) [0x7f16cb13f830]
  2024. 11: (_start()+0x29) [0x880389]
  2025. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  2026.  
  2027. --- logging levels ---
  2028. 0/ 5 none
  2029. 0/ 0 lockdep
  2030. 0/ 0 context
  2031. 0/ 0 crush
  2032. 1/ 5 mds
  2033. 1/ 5 mds_balancer
  2034. 1/ 5 mds_locker
  2035. 1/ 5 mds_log
  2036. 1/ 5 mds_log_expire
  2037. 1/ 5 mds_migrator
  2038. 0/ 0 buffer
  2039. 0/ 0 timer
  2040. 0/ 0 filer
  2041. 0/ 1 striper
  2042. 0/ 0 objecter
  2043. 0/ 0 rados
  2044. 0/ 0 rbd
  2045. 0/ 5 rbd_mirror
  2046. 0/ 5 rbd_replay
  2047. 0/ 0 journaler
  2048. 0/ 0 objectcacher
  2049. 0/ 0 client
  2050. 0/ 0 osd
  2051. 0/ 0 optracker
  2052. 0/ 0 objclass
  2053. 0/ 0 filestore
  2054. 0/ 0 journal
  2055. 0/ 0 ms
  2056. 0/ 0 mon
  2057. 0/ 0 monc
  2058. 0/ 0 paxos
  2059. 0/ 0 tp
  2060. 0/ 0 auth
  2061. 1/ 5 crypto
  2062. 0/ 0 finisher
  2063. 1/ 1 reserver
  2064. 0/ 0 heartbeatmap
  2065. 0/ 0 perfcounter
  2066. 0/ 0 rgw
  2067. 1/ 5 rgw_sync
  2068. 1/10 civetweb
  2069. 1/ 5 javaclient
  2070. 0/ 0 asok
  2071. 0/ 0 throttle
  2072. 0/ 0 refs
  2073. 1/ 5 xio
  2074. 1/ 5 compressor
  2075. 0/ 0 bluestore
  2076. 1/ 5 bluefs
  2077. 1/ 3 bdev
  2078. 1/ 5 kstore
  2079. 4/ 5 rocksdb
  2080. 4/ 5 leveldb
  2081. 4/ 5 memdb
  2082. 1/ 5 kinetic
  2083. 1/ 5 fuse
  2084. 1/ 5 mgr
  2085. 1/ 5 mgrc
  2086. 1/ 5 dpdk
  2087. 1/ 5 eventtrace
  2088. 1/ 5 prioritycache
  2089. -2/-2 (syslog threshold)
  2090. -1/-1 (stderr threshold)
  2091. max_recent 10000
  2092. max_new 1000
  2093. log_file /var/log/ceph/ceph-osd.108.log
  2094. --- end dump of recent events ---
  2095. 2020-08-27 14:41:15.616 7f70d4497c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  2096. 2020-08-27 14:41:15.616 7f70d4497c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3558341
  2097. 2020-08-27 14:41:15.616 7f70d4497c00 0 pidfile_write: ignore empty --pid-file
  2098. 2020-08-27 14:41:15.616 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2099. 2020-08-27 14:41:15.616 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2100. 2020-08-27 14:41:15.616 7f70d4497c00 0 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2101. 2020-08-27 14:41:15.616 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2102. 2020-08-27 14:41:15.616 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2103. 2020-08-27 14:41:15.616 7f70d4497c00 1 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2104. 2020-08-27 14:41:15.616 7f70d4497c00 0 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2105. 2020-08-27 14:41:15.616 7f70d4497c00 1 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2106. 2020-08-27 14:41:15.616 7f70d4497c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2107. 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2108. 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2109. 2020-08-27 14:41:15.620 7f70d4497c00 0 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2110. 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2111. 2020-08-27 14:41:15.620 7f70d4497c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2112. 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2113. 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2114. 2020-08-27 14:41:15.620 7f70d4497c00 0 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2115. 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2116. 2020-08-27 14:41:15.620 7f70d4497c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2117. 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  2118. 2020-08-27 14:41:15.936 7f70d4497c00 1 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block.db) close
  2119. 2020-08-27 14:41:16.216 7f70d4497c00 1 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block) close
  2120. 2020-08-27 14:41:16.456 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) close
  2121. 2020-08-27 14:41:16.684 7f70d4497c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  2122. 2020-08-27 14:41:16.692 7f70d4497c00 0 load: jerasure load: lrc load: isa
  2123. 2020-08-27 14:41:16.692 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2124. 2020-08-27 14:41:16.692 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2125. 2020-08-27 14:41:16.692 7f70d4497c00 0 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2126. 2020-08-27 14:41:16.692 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2127. 2020-08-27 14:41:16.692 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) close
  2128. 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2129. 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2130. 2020-08-27 14:41:17.020 7f70d4497c00 0 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2131. 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2132. 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2133. 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2134. 2020-08-27 14:41:17.020 7f70d4497c00 0 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2135. 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2136. 2020-08-27 14:41:17.020 7f70d4497c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2137. 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2138. 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2139. 2020-08-27 14:41:17.020 7f70d4497c00 0 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2140. 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2141. 2020-08-27 14:41:17.020 7f70d4497c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2142. 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2143. 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2144. 2020-08-27 14:41:17.020 7f70d4497c00 0 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2145. 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2146. 2020-08-27 14:41:17.020 7f70d4497c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2147. 2020-08-27 14:41:17.020 7f70d4497c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  2148. 2020-08-27 14:41:17.020 7f70d4497c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  2149. 2020-08-27 14:41:17.024 7f70d4497c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f70d4497c00 time 2020-08-27 14:41:17.024268
  2150. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  2151.  
  2152. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2153. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  2154. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2155. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2156. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2157. 5: (OSD::init()+0x3f3) [0x8f5483]
  2158. 6: (main()+0x27e2) [0x84c462]
  2159. 7: (__libc_start_main()+0xf0) [0x7f70d1648830]
  2160. 8: (_start()+0x29) [0x880389]
  2161.  
  2162. 2020-08-27 14:41:17.028 7f70d4497c00 -1 *** Caught signal (Aborted) **
  2163. in thread 7f70d4497c00 thread_name:ceph-osd
  2164.  
  2165. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2166. 1: (()+0x11390) [0x7f70d2132390]
  2167. 2: (gsignal()+0x38) [0x7f70d165d428]
  2168. 3: (abort()+0x16a) [0x7f70d165f02a]
  2169. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  2170. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2171. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2172. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2173. 8: (OSD::init()+0x3f3) [0x8f5483]
  2174. 9: (main()+0x27e2) [0x84c462]
  2175. 10: (__libc_start_main()+0xf0) [0x7f70d1648830]
  2176. 11: (_start()+0x29) [0x880389]
  2177. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  2178.  
  2179. --- begin dump of recent events ---
  2180. -77> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command assert hook 0xaf2c100
  2181. -76> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command abort hook 0xaf2c100
  2182. -75> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command perfcounters_dump hook 0xaf2c100
  2183. -74> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command 1 hook 0xaf2c100
  2184. -73> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command perf dump hook 0xaf2c100
  2185. -72> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command perfcounters_schema hook 0xaf2c100
  2186. -71> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command perf histogram dump hook 0xaf2c100
  2187. -70> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command 2 hook 0xaf2c100
  2188. -69> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command perf schema hook 0xaf2c100
  2189. -68> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command perf histogram schema hook 0xaf2c100
  2190. -67> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command perf reset hook 0xaf2c100
  2191. -66> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command config show hook 0xaf2c100
  2192. -65> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command config help hook 0xaf2c100
  2193. -64> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command config set hook 0xaf2c100
  2194. -63> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command config unset hook 0xaf2c100
  2195. -62> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command config get hook 0xaf2c100
  2196. -61> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command config diff hook 0xaf2c100
  2197. -60> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command config diff get hook 0xaf2c100
  2198. -59> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command log flush hook 0xaf2c100
  2199. -58> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command log dump hook 0xaf2c100
  2200. -57> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command log reopen hook 0xaf2c100
  2201. -56> 2020-08-27 14:41:15.604 7f70d4497c00 5 asok(0xaff2000) register_command dump_mempools hook 0xbbea068
  2202. -55> 2020-08-27 14:41:15.616 7f70d4497c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  2203. -54> 2020-08-27 14:41:15.616 7f70d4497c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3558341
  2204. -53> 2020-08-27 14:41:15.616 7f70d4497c00 0 pidfile_write: ignore empty --pid-file
  2205. -52> 2020-08-27 14:41:15.616 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2206. -51> 2020-08-27 14:41:15.616 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2207. -50> 2020-08-27 14:41:15.616 7f70d4497c00 0 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2208. -49> 2020-08-27 14:41:15.616 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2209. -48> 2020-08-27 14:41:15.616 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2210. -47> 2020-08-27 14:41:15.616 7f70d4497c00 1 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2211. -46> 2020-08-27 14:41:15.616 7f70d4497c00 0 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2212. -45> 2020-08-27 14:41:15.616 7f70d4497c00 1 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2213. -44> 2020-08-27 14:41:15.616 7f70d4497c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2214. -43> 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2215. -42> 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2216. -41> 2020-08-27 14:41:15.620 7f70d4497c00 0 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2217. -40> 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2218. -39> 2020-08-27 14:41:15.620 7f70d4497c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2219. -38> 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2220. -37> 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2221. -36> 2020-08-27 14:41:15.620 7f70d4497c00 0 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2222. -35> 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2223. -34> 2020-08-27 14:41:15.620 7f70d4497c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2224. -33> 2020-08-27 14:41:15.620 7f70d4497c00 1 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  2225. -32> 2020-08-27 14:41:15.936 7f70d4497c00 1 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block.db) close
  2226. -31> 2020-08-27 14:41:16.216 7f70d4497c00 1 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block) close
  2227. -30> 2020-08-27 14:41:16.456 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) close
  2228. -29> 2020-08-27 14:41:16.684 7f70d4497c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  2229. -28> 2020-08-27 14:41:16.692 7f70d4497c00 0 load: jerasure load: lrc load: isa
  2230. -27> 2020-08-27 14:41:16.692 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2231. -26> 2020-08-27 14:41:16.692 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2232. -25> 2020-08-27 14:41:16.692 7f70d4497c00 0 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2233. -24> 2020-08-27 14:41:16.692 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2234. -23> 2020-08-27 14:41:16.692 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) close
  2235. -22> 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2236. -21> 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2237. -20> 2020-08-27 14:41:17.020 7f70d4497c00 0 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2238. -19> 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2239. -18> 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2240. -17> 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2241. -16> 2020-08-27 14:41:17.020 7f70d4497c00 0 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2242. -15> 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2243. -14> 2020-08-27 14:41:17.020 7f70d4497c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2244. -13> 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2245. -12> 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2246. -11> 2020-08-27 14:41:17.020 7f70d4497c00 0 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2247. -10> 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2248. -9> 2020-08-27 14:41:17.020 7f70d4497c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2249. -8> 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2250. -7> 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2251. -6> 2020-08-27 14:41:17.020 7f70d4497c00 0 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2252. -5> 2020-08-27 14:41:17.020 7f70d4497c00 1 bdev(0xbce8a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2253. -4> 2020-08-27 14:41:17.020 7f70d4497c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2254. -3> 2020-08-27 14:41:17.020 7f70d4497c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  2255. -2> 2020-08-27 14:41:17.020 7f70d4497c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  2256. -1> 2020-08-27 14:41:17.024 7f70d4497c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f70d4497c00 time 2020-08-27 14:41:17.024268
  2257. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  2258.  
  2259. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2260. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  2261. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2262. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2263. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2264. 5: (OSD::init()+0x3f3) [0x8f5483]
  2265. 6: (main()+0x27e2) [0x84c462]
  2266. 7: (__libc_start_main()+0xf0) [0x7f70d1648830]
  2267. 8: (_start()+0x29) [0x880389]
  2268.  
  2269. 0> 2020-08-27 14:41:17.028 7f70d4497c00 -1 *** Caught signal (Aborted) **
  2270. in thread 7f70d4497c00 thread_name:ceph-osd
  2271.  
  2272. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2273. 1: (()+0x11390) [0x7f70d2132390]
  2274. 2: (gsignal()+0x38) [0x7f70d165d428]
  2275. 3: (abort()+0x16a) [0x7f70d165f02a]
  2276. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  2277. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2278. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2279. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2280. 8: (OSD::init()+0x3f3) [0x8f5483]
  2281. 9: (main()+0x27e2) [0x84c462]
  2282. 10: (__libc_start_main()+0xf0) [0x7f70d1648830]
  2283. 11: (_start()+0x29) [0x880389]
  2284. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  2285.  
  2286. --- logging levels ---
  2287. 0/ 5 none
  2288. 0/ 0 lockdep
  2289. 0/ 0 context
  2290. 0/ 0 crush
  2291. 1/ 5 mds
  2292. 1/ 5 mds_balancer
  2293. 1/ 5 mds_locker
  2294. 1/ 5 mds_log
  2295. 1/ 5 mds_log_expire
  2296. 1/ 5 mds_migrator
  2297. 0/ 0 buffer
  2298. 0/ 0 timer
  2299. 0/ 0 filer
  2300. 0/ 1 striper
  2301. 0/ 0 objecter
  2302. 0/ 0 rados
  2303. 0/ 0 rbd
  2304. 0/ 5 rbd_mirror
  2305. 0/ 5 rbd_replay
  2306. 0/ 0 journaler
  2307. 0/ 0 objectcacher
  2308. 0/ 0 client
  2309. 0/ 0 osd
  2310. 0/ 0 optracker
  2311. 0/ 0 objclass
  2312. 0/ 0 filestore
  2313. 0/ 0 journal
  2314. 0/ 0 ms
  2315. 0/ 0 mon
  2316. 0/ 0 monc
  2317. 0/ 0 paxos
  2318. 0/ 0 tp
  2319. 0/ 0 auth
  2320. 1/ 5 crypto
  2321. 0/ 0 finisher
  2322. 1/ 1 reserver
  2323. 0/ 0 heartbeatmap
  2324. 0/ 0 perfcounter
  2325. 0/ 0 rgw
  2326. 1/ 5 rgw_sync
  2327. 1/10 civetweb
  2328. 1/ 5 javaclient
  2329. 0/ 0 asok
  2330. 0/ 0 throttle
  2331. 0/ 0 refs
  2332. 1/ 5 xio
  2333. 1/ 5 compressor
  2334. 0/ 0 bluestore
  2335. 1/ 5 bluefs
  2336. 1/ 3 bdev
  2337. 1/ 5 kstore
  2338. 4/ 5 rocksdb
  2339. 4/ 5 leveldb
  2340. 4/ 5 memdb
  2341. 1/ 5 kinetic
  2342. 1/ 5 fuse
  2343. 1/ 5 mgr
  2344. 1/ 5 mgrc
  2345. 1/ 5 dpdk
  2346. 1/ 5 eventtrace
  2347. 1/ 5 prioritycache
  2348. -2/-2 (syslog threshold)
  2349. -1/-1 (stderr threshold)
  2350. max_recent 10000
  2351. max_new 1000
  2352. log_file /var/log/ceph/ceph-osd.108.log
  2353. --- end dump of recent events ---
  2354. 2020-08-27 14:41:17.596 7fbbde784c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  2355. 2020-08-27 14:41:17.596 7fbbde784c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3559337
  2356. 2020-08-27 14:41:17.596 7fbbde784c00 0 pidfile_write: ignore empty --pid-file
  2357. 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2358. 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2359. 2020-08-27 14:41:17.596 7fbbde784c00 0 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2360. 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2361. 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2362. 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2363. 2020-08-27 14:41:17.596 7fbbde784c00 0 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2364. 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2365. 2020-08-27 14:41:17.596 7fbbde784c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2366. 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2367. 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2368. 2020-08-27 14:41:17.596 7fbbde784c00 0 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2369. 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2370. 2020-08-27 14:41:17.596 7fbbde784c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2371. 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2372. 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2373. 2020-08-27 14:41:17.596 7fbbde784c00 0 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2374. 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2375. 2020-08-27 14:41:17.600 7fbbde784c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2376. 2020-08-27 14:41:17.600 7fbbde784c00 1 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  2377. 2020-08-27 14:41:17.920 7fbbde784c00 1 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block.db) close
  2378. 2020-08-27 14:41:18.224 7fbbde784c00 1 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block) close
  2379. 2020-08-27 14:41:18.420 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) close
  2380. 2020-08-27 14:41:18.644 7fbbde784c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  2381. 2020-08-27 14:41:18.652 7fbbde784c00 0 load: jerasure load: lrc load: isa
  2382. 2020-08-27 14:41:18.652 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2383. 2020-08-27 14:41:18.652 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2384. 2020-08-27 14:41:18.652 7fbbde784c00 0 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2385. 2020-08-27 14:41:18.660 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2386. 2020-08-27 14:41:18.660 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) close
  2387. 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2388. 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2389. 2020-08-27 14:41:18.964 7fbbde784c00 0 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2390. 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2391. 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2392. 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2393. 2020-08-27 14:41:18.964 7fbbde784c00 0 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2394. 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2395. 2020-08-27 14:41:18.964 7fbbde784c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2396. 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2397. 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2398. 2020-08-27 14:41:18.964 7fbbde784c00 0 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2399. 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2400. 2020-08-27 14:41:18.964 7fbbde784c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2401. 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2402. 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2403. 2020-08-27 14:41:18.964 7fbbde784c00 0 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2404. 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2405. 2020-08-27 14:41:18.964 7fbbde784c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2406. 2020-08-27 14:41:18.964 7fbbde784c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  2407. 2020-08-27 14:41:18.964 7fbbde784c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  2408. 2020-08-27 14:41:18.968 7fbbde784c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7fbbde784c00 time 2020-08-27 14:41:18.967879
  2409. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  2410.  
  2411. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2412. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  2413. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2414. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2415. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2416. 5: (OSD::init()+0x3f3) [0x8f5483]
  2417. 6: (main()+0x27e2) [0x84c462]
  2418. 7: (__libc_start_main()+0xf0) [0x7fbbdb935830]
  2419. 8: (_start()+0x29) [0x880389]
  2420.  
  2421. 2020-08-27 14:41:18.972 7fbbde784c00 -1 *** Caught signal (Aborted) **
  2422. in thread 7fbbde784c00 thread_name:ceph-osd
  2423.  
  2424. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2425. 1: (()+0x11390) [0x7fbbdc41f390]
  2426. 2: (gsignal()+0x38) [0x7fbbdb94a428]
  2427. 3: (abort()+0x16a) [0x7fbbdb94c02a]
  2428. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  2429. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2430. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2431. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2432. 8: (OSD::init()+0x3f3) [0x8f5483]
  2433. 9: (main()+0x27e2) [0x84c462]
  2434. 10: (__libc_start_main()+0xf0) [0x7fbbdb935830]
  2435. 11: (_start()+0x29) [0x880389]
  2436. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  2437.  
  2438. --- begin dump of recent events ---
  2439. -77> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command assert hook 0xb340100
  2440. -76> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command abort hook 0xb340100
  2441. -75> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command perfcounters_dump hook 0xb340100
  2442. -74> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command 1 hook 0xb340100
  2443. -73> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command perf dump hook 0xb340100
  2444. -72> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command perfcounters_schema hook 0xb340100
  2445. -71> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command perf histogram dump hook 0xb340100
  2446. -70> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command 2 hook 0xb340100
  2447. -69> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command perf schema hook 0xb340100
  2448. -68> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command perf histogram schema hook 0xb340100
  2449. -67> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command perf reset hook 0xb340100
  2450. -66> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command config show hook 0xb340100
  2451. -65> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command config help hook 0xb340100
  2452. -64> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command config set hook 0xb340100
  2453. -63> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command config unset hook 0xb340100
  2454. -62> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command config get hook 0xb340100
  2455. -61> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command config diff hook 0xb340100
  2456. -60> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command config diff get hook 0xb340100
  2457. -59> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command log flush hook 0xb340100
  2458. -58> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command log dump hook 0xb340100
  2459. -57> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command log reopen hook 0xb340100
  2460. -56> 2020-08-27 14:41:17.584 7fbbde784c00 5 asok(0xb406000) register_command dump_mempools hook 0xbffe068
  2461. -55> 2020-08-27 14:41:17.596 7fbbde784c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  2462. -54> 2020-08-27 14:41:17.596 7fbbde784c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3559337
  2463. -53> 2020-08-27 14:41:17.596 7fbbde784c00 0 pidfile_write: ignore empty --pid-file
  2464. -52> 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2465. -51> 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2466. -50> 2020-08-27 14:41:17.596 7fbbde784c00 0 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2467. -49> 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2468. -48> 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2469. -47> 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2470. -46> 2020-08-27 14:41:17.596 7fbbde784c00 0 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2471. -45> 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2472. -44> 2020-08-27 14:41:17.596 7fbbde784c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2473. -43> 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2474. -42> 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2475. -41> 2020-08-27 14:41:17.596 7fbbde784c00 0 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2476. -40> 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2477. -39> 2020-08-27 14:41:17.596 7fbbde784c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2478. -38> 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2479. -37> 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2480. -36> 2020-08-27 14:41:17.596 7fbbde784c00 0 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2481. -35> 2020-08-27 14:41:17.596 7fbbde784c00 1 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2482. -34> 2020-08-27 14:41:17.600 7fbbde784c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2483. -33> 2020-08-27 14:41:17.600 7fbbde784c00 1 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  2484. -32> 2020-08-27 14:41:17.920 7fbbde784c00 1 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block.db) close
  2485. -31> 2020-08-27 14:41:18.224 7fbbde784c00 1 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block) close
  2486. -30> 2020-08-27 14:41:18.420 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) close
  2487. -29> 2020-08-27 14:41:18.644 7fbbde784c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  2488. -28> 2020-08-27 14:41:18.652 7fbbde784c00 0 load: jerasure load: lrc load: isa
  2489. -27> 2020-08-27 14:41:18.652 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2490. -26> 2020-08-27 14:41:18.652 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2491. -25> 2020-08-27 14:41:18.652 7fbbde784c00 0 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2492. -24> 2020-08-27 14:41:18.660 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2493. -23> 2020-08-27 14:41:18.660 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) close
  2494. -22> 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2495. -21> 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2496. -20> 2020-08-27 14:41:18.964 7fbbde784c00 0 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2497. -19> 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2498. -18> 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2499. -17> 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2500. -16> 2020-08-27 14:41:18.964 7fbbde784c00 0 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2501. -15> 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2502. -14> 2020-08-27 14:41:18.964 7fbbde784c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2503. -13> 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2504. -12> 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2505. -11> 2020-08-27 14:41:18.964 7fbbde784c00 0 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2506. -10> 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fc700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2507. -9> 2020-08-27 14:41:18.964 7fbbde784c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2508. -8> 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2509. -7> 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2510. -6> 2020-08-27 14:41:18.964 7fbbde784c00 0 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2511. -5> 2020-08-27 14:41:18.964 7fbbde784c00 1 bdev(0xc0fca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2512. -4> 2020-08-27 14:41:18.964 7fbbde784c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2513. -3> 2020-08-27 14:41:18.964 7fbbde784c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  2514. -2> 2020-08-27 14:41:18.964 7fbbde784c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  2515. -1> 2020-08-27 14:41:18.968 7fbbde784c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7fbbde784c00 time 2020-08-27 14:41:18.967879
  2516. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  2517.  
  2518. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2519. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  2520. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2521. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2522. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2523. 5: (OSD::init()+0x3f3) [0x8f5483]
  2524. 6: (main()+0x27e2) [0x84c462]
  2525. 7: (__libc_start_main()+0xf0) [0x7fbbdb935830]
  2526. 8: (_start()+0x29) [0x880389]
  2527.  
  2528. 0> 2020-08-27 14:41:18.972 7fbbde784c00 -1 *** Caught signal (Aborted) **
  2529. in thread 7fbbde784c00 thread_name:ceph-osd
  2530.  
  2531. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2532. 1: (()+0x11390) [0x7fbbdc41f390]
  2533. 2: (gsignal()+0x38) [0x7fbbdb94a428]
  2534. 3: (abort()+0x16a) [0x7fbbdb94c02a]
  2535. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  2536. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2537. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2538. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2539. 8: (OSD::init()+0x3f3) [0x8f5483]
  2540. 9: (main()+0x27e2) [0x84c462]
  2541. 10: (__libc_start_main()+0xf0) [0x7fbbdb935830]
  2542. 11: (_start()+0x29) [0x880389]
  2543. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  2544.  
  2545. --- logging levels ---
  2546. 0/ 5 none
  2547. 0/ 0 lockdep
  2548. 0/ 0 context
  2549. 0/ 0 crush
  2550. 1/ 5 mds
  2551. 1/ 5 mds_balancer
  2552. 1/ 5 mds_locker
  2553. 1/ 5 mds_log
  2554. 1/ 5 mds_log_expire
  2555. 1/ 5 mds_migrator
  2556. 0/ 0 buffer
  2557. 0/ 0 timer
  2558. 0/ 0 filer
  2559. 0/ 1 striper
  2560. 0/ 0 objecter
  2561. 0/ 0 rados
  2562. 0/ 0 rbd
  2563. 0/ 5 rbd_mirror
  2564. 0/ 5 rbd_replay
  2565. 0/ 0 journaler
  2566. 0/ 0 objectcacher
  2567. 0/ 0 client
  2568. 0/ 0 osd
  2569. 0/ 0 optracker
  2570. 0/ 0 objclass
  2571. 0/ 0 filestore
  2572. 0/ 0 journal
  2573. 0/ 0 ms
  2574. 0/ 0 mon
  2575. 0/ 0 monc
  2576. 0/ 0 paxos
  2577. 0/ 0 tp
  2578. 0/ 0 auth
  2579. 1/ 5 crypto
  2580. 0/ 0 finisher
  2581. 1/ 1 reserver
  2582. 0/ 0 heartbeatmap
  2583. 0/ 0 perfcounter
  2584. 0/ 0 rgw
  2585. 1/ 5 rgw_sync
  2586. 1/10 civetweb
  2587. 1/ 5 javaclient
  2588. 0/ 0 asok
  2589. 0/ 0 throttle
  2590. 0/ 0 refs
  2591. 1/ 5 xio
  2592. 1/ 5 compressor
  2593. 0/ 0 bluestore
  2594. 1/ 5 bluefs
  2595. 1/ 3 bdev
  2596. 1/ 5 kstore
  2597. 4/ 5 rocksdb
  2598. 4/ 5 leveldb
  2599. 4/ 5 memdb
  2600. 1/ 5 kinetic
  2601. 1/ 5 fuse
  2602. 1/ 5 mgr
  2603. 1/ 5 mgrc
  2604. 1/ 5 dpdk
  2605. 1/ 5 eventtrace
  2606. 1/ 5 prioritycache
  2607. -2/-2 (syslog threshold)
  2608. -1/-1 (stderr threshold)
  2609. max_recent 10000
  2610. max_new 1000
  2611. log_file /var/log/ceph/ceph-osd.108.log
  2612. --- end dump of recent events ---
  2613. 2020-08-27 14:41:19.480 7fd1ec7cbc00 0 set uid:gid to 64045:64045 (ceph:ceph)
  2614. 2020-08-27 14:41:19.480 7fd1ec7cbc00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3560153
  2615. 2020-08-27 14:41:19.480 7fd1ec7cbc00 0 pidfile_write: ignore empty --pid-file
  2616. 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2617. 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2618. 2020-08-27 14:41:19.480 7fd1ec7cbc00 0 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2619. 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2620. 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2621. 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2622. 2020-08-27 14:41:19.480 7fd1ec7cbc00 0 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2623. 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2624. 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2625. 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2626. 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2627. 2020-08-27 14:41:19.480 7fd1ec7cbc00 0 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2628. 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2629. 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2630. 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2631. 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2632. 2020-08-27 14:41:19.484 7fd1ec7cbc00 0 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2633. 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2634. 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2635. 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  2636. 2020-08-27 14:41:19.788 7fd1ec7cbc00 1 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block.db) close
  2637. 2020-08-27 14:41:20.044 7fd1ec7cbc00 1 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block) close
  2638. 2020-08-27 14:41:20.288 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) close
  2639. 2020-08-27 14:41:20.564 7fd1ec7cbc00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  2640. 2020-08-27 14:41:20.572 7fd1ec7cbc00 0 load: jerasure load: lrc load: isa
  2641. 2020-08-27 14:41:20.572 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2642. 2020-08-27 14:41:20.572 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2643. 2020-08-27 14:41:20.572 7fd1ec7cbc00 0 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2644. 2020-08-27 14:41:20.572 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2645. 2020-08-27 14:41:20.572 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) close
  2646. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2647. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2648. 2020-08-27 14:41:20.888 7fd1ec7cbc00 0 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2649. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2650. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2651. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2652. 2020-08-27 14:41:20.888 7fd1ec7cbc00 0 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2653. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2654. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2655. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2656. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2657. 2020-08-27 14:41:20.888 7fd1ec7cbc00 0 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2658. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2659. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2660. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2661. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2662. 2020-08-27 14:41:20.888 7fd1ec7cbc00 0 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2663. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2664. 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2665. 2020-08-27 14:41:20.888 7fd1ec7cbc00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  2666. 2020-08-27 14:41:20.888 7fd1ec7cbc00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  2667. 2020-08-27 14:41:20.892 7fd1ec7cbc00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7fd1ec7cbc00 time 2020-08-27 14:41:20.895665
  2668. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  2669.  
  2670. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2671. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  2672. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2673. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2674. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2675. 5: (OSD::init()+0x3f3) [0x8f5483]
  2676. 6: (main()+0x27e2) [0x84c462]
  2677. 7: (__libc_start_main()+0xf0) [0x7fd1e997c830]
  2678. 8: (_start()+0x29) [0x880389]
  2679.  
  2680. 2020-08-27 14:41:20.896 7fd1ec7cbc00 -1 *** Caught signal (Aborted) **
  2681. in thread 7fd1ec7cbc00 thread_name:ceph-osd
  2682.  
  2683. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2684. 1: (()+0x11390) [0x7fd1ea466390]
  2685. 2: (gsignal()+0x38) [0x7fd1e9991428]
  2686. 3: (abort()+0x16a) [0x7fd1e999302a]
  2687. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  2688. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2689. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2690. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2691. 8: (OSD::init()+0x3f3) [0x8f5483]
  2692. 9: (main()+0x27e2) [0x84c462]
  2693. 10: (__libc_start_main()+0xf0) [0x7fd1e997c830]
  2694. 11: (_start()+0x29) [0x880389]
  2695. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  2696.  
  2697. --- begin dump of recent events ---
  2698. -77> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command assert hook 0xb080100
  2699. -76> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command abort hook 0xb080100
  2700. -75> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command perfcounters_dump hook 0xb080100
  2701. -74> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command 1 hook 0xb080100
  2702. -73> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command perf dump hook 0xb080100
  2703. -72> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command perfcounters_schema hook 0xb080100
  2704. -71> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command perf histogram dump hook 0xb080100
  2705. -70> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command 2 hook 0xb080100
  2706. -69> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command perf schema hook 0xb080100
  2707. -68> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command perf histogram schema hook 0xb080100
  2708. -67> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command perf reset hook 0xb080100
  2709. -66> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command config show hook 0xb080100
  2710. -65> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command config help hook 0xb080100
  2711. -64> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command config set hook 0xb080100
  2712. -63> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command config unset hook 0xb080100
  2713. -62> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command config get hook 0xb080100
  2714. -61> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command config diff hook 0xb080100
  2715. -60> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command config diff get hook 0xb080100
  2716. -59> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command log flush hook 0xb080100
  2717. -58> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command log dump hook 0xb080100
  2718. -57> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command log reopen hook 0xb080100
  2719. -56> 2020-08-27 14:41:19.468 7fd1ec7cbc00 5 asok(0xb146000) register_command dump_mempools hook 0xbd3e068
  2720. -55> 2020-08-27 14:41:19.480 7fd1ec7cbc00 0 set uid:gid to 64045:64045 (ceph:ceph)
  2721. -54> 2020-08-27 14:41:19.480 7fd1ec7cbc00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3560153
  2722. -53> 2020-08-27 14:41:19.480 7fd1ec7cbc00 0 pidfile_write: ignore empty --pid-file
  2723. -52> 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2724. -51> 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2725. -50> 2020-08-27 14:41:19.480 7fd1ec7cbc00 0 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2726. -49> 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2727. -48> 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2728. -47> 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2729. -46> 2020-08-27 14:41:19.480 7fd1ec7cbc00 0 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2730. -45> 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2731. -44> 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2732. -43> 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2733. -42> 2020-08-27 14:41:19.480 7fd1ec7cbc00 1 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2734. -41> 2020-08-27 14:41:19.480 7fd1ec7cbc00 0 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2735. -40> 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2736. -39> 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2737. -38> 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2738. -37> 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2739. -36> 2020-08-27 14:41:19.484 7fd1ec7cbc00 0 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2740. -35> 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2741. -34> 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2742. -33> 2020-08-27 14:41:19.484 7fd1ec7cbc00 1 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  2743. -32> 2020-08-27 14:41:19.788 7fd1ec7cbc00 1 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block.db) close
  2744. -31> 2020-08-27 14:41:20.044 7fd1ec7cbc00 1 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block) close
  2745. -30> 2020-08-27 14:41:20.288 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) close
  2746. -29> 2020-08-27 14:41:20.564 7fd1ec7cbc00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  2747. -28> 2020-08-27 14:41:20.572 7fd1ec7cbc00 0 load: jerasure load: lrc load: isa
  2748. -27> 2020-08-27 14:41:20.572 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2749. -26> 2020-08-27 14:41:20.572 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2750. -25> 2020-08-27 14:41:20.572 7fd1ec7cbc00 0 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2751. -24> 2020-08-27 14:41:20.572 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2752. -23> 2020-08-27 14:41:20.572 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) close
  2753. -22> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2754. -21> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2755. -20> 2020-08-27 14:41:20.888 7fd1ec7cbc00 0 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2756. -19> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2757. -18> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2758. -17> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2759. -16> 2020-08-27 14:41:20.888 7fd1ec7cbc00 0 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2760. -15> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3ce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2761. -14> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2762. -13> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2763. -12> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2764. -11> 2020-08-27 14:41:20.888 7fd1ec7cbc00 0 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2765. -10> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3c700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2766. -9> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2767. -8> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2768. -7> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2769. -6> 2020-08-27 14:41:20.888 7fd1ec7cbc00 0 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2770. -5> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bdev(0xbe3ca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2771. -4> 2020-08-27 14:41:20.888 7fd1ec7cbc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2772. -3> 2020-08-27 14:41:20.888 7fd1ec7cbc00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  2773. -2> 2020-08-27 14:41:20.888 7fd1ec7cbc00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  2774. -1> 2020-08-27 14:41:20.892 7fd1ec7cbc00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7fd1ec7cbc00 time 2020-08-27 14:41:20.895665
  2775. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  2776.  
  2777. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2778. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  2779. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2780. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2781. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2782. 5: (OSD::init()+0x3f3) [0x8f5483]
  2783. 6: (main()+0x27e2) [0x84c462]
  2784. 7: (__libc_start_main()+0xf0) [0x7fd1e997c830]
  2785. 8: (_start()+0x29) [0x880389]
  2786.  
  2787. 0> 2020-08-27 14:41:20.896 7fd1ec7cbc00 -1 *** Caught signal (Aborted) **
  2788. in thread 7fd1ec7cbc00 thread_name:ceph-osd
  2789.  
  2790. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2791. 1: (()+0x11390) [0x7fd1ea466390]
  2792. 2: (gsignal()+0x38) [0x7fd1e9991428]
  2793. 3: (abort()+0x16a) [0x7fd1e999302a]
  2794. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  2795. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2796. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2797. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2798. 8: (OSD::init()+0x3f3) [0x8f5483]
  2799. 9: (main()+0x27e2) [0x84c462]
  2800. 10: (__libc_start_main()+0xf0) [0x7fd1e997c830]
  2801. 11: (_start()+0x29) [0x880389]
  2802. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  2803.  
  2804. --- logging levels ---
  2805. 0/ 5 none
  2806. 0/ 0 lockdep
  2807. 0/ 0 context
  2808. 0/ 0 crush
  2809. 1/ 5 mds
  2810. 1/ 5 mds_balancer
  2811. 1/ 5 mds_locker
  2812. 1/ 5 mds_log
  2813. 1/ 5 mds_log_expire
  2814. 1/ 5 mds_migrator
  2815. 0/ 0 buffer
  2816. 0/ 0 timer
  2817. 0/ 0 filer
  2818. 0/ 1 striper
  2819. 0/ 0 objecter
  2820. 0/ 0 rados
  2821. 0/ 0 rbd
  2822. 0/ 5 rbd_mirror
  2823. 0/ 5 rbd_replay
  2824. 0/ 0 journaler
  2825. 0/ 0 objectcacher
  2826. 0/ 0 client
  2827. 0/ 0 osd
  2828. 0/ 0 optracker
  2829. 0/ 0 objclass
  2830. 0/ 0 filestore
  2831. 0/ 0 journal
  2832. 0/ 0 ms
  2833. 0/ 0 mon
  2834. 0/ 0 monc
  2835. 0/ 0 paxos
  2836. 0/ 0 tp
  2837. 0/ 0 auth
  2838. 1/ 5 crypto
  2839. 0/ 0 finisher
  2840. 1/ 1 reserver
  2841. 0/ 0 heartbeatmap
  2842. 0/ 0 perfcounter
  2843. 0/ 0 rgw
  2844. 1/ 5 rgw_sync
  2845. 1/10 civetweb
  2846. 1/ 5 javaclient
  2847. 0/ 0 asok
  2848. 0/ 0 throttle
  2849. 0/ 0 refs
  2850. 1/ 5 xio
  2851. 1/ 5 compressor
  2852. 0/ 0 bluestore
  2853. 1/ 5 bluefs
  2854. 1/ 3 bdev
  2855. 1/ 5 kstore
  2856. 4/ 5 rocksdb
  2857. 4/ 5 leveldb
  2858. 4/ 5 memdb
  2859. 1/ 5 kinetic
  2860. 1/ 5 fuse
  2861. 1/ 5 mgr
  2862. 1/ 5 mgrc
  2863. 1/ 5 dpdk
  2864. 1/ 5 eventtrace
  2865. 1/ 5 prioritycache
  2866. -2/-2 (syslog threshold)
  2867. -1/-1 (stderr threshold)
  2868. max_recent 10000
  2869. max_new 1000
  2870. log_file /var/log/ceph/ceph-osd.108.log
  2871. --- end dump of recent events ---
  2872. 2020-08-27 14:41:21.648 7f1f1eff7c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  2873. 2020-08-27 14:41:21.648 7f1f1eff7c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3561108
  2874. 2020-08-27 14:41:21.648 7f1f1eff7c00 0 pidfile_write: ignore empty --pid-file
  2875. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2876. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2877. 2020-08-27 14:41:21.652 7f1f1eff7c00 0 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2878. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2879. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2880. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2881. 2020-08-27 14:41:21.652 7f1f1eff7c00 0 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2882. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2883. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2884. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2885. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2886. 2020-08-27 14:41:21.652 7f1f1eff7c00 0 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2887. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2888. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2889. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2890. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2891. 2020-08-27 14:41:21.652 7f1f1eff7c00 0 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2892. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2893. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2894. 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  2895. 2020-08-27 14:41:21.964 7f1f1eff7c00 1 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block.db) close
  2896. 2020-08-27 14:41:22.248 7f1f1eff7c00 1 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block) close
  2897. 2020-08-27 14:41:22.484 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) close
  2898. 2020-08-27 14:41:22.720 7f1f1eff7c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  2899. 2020-08-27 14:41:22.732 7f1f1eff7c00 0 load: jerasure load: lrc load: isa
  2900. 2020-08-27 14:41:22.732 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2901. 2020-08-27 14:41:22.732 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2902. 2020-08-27 14:41:22.732 7f1f1eff7c00 0 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2903. 2020-08-27 14:41:22.732 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2904. 2020-08-27 14:41:22.732 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) close
  2905. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2906. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2907. 2020-08-27 14:41:23.084 7f1f1eff7c00 0 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2908. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2909. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2910. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2911. 2020-08-27 14:41:23.084 7f1f1eff7c00 0 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2912. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2913. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2914. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2915. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2916. 2020-08-27 14:41:23.084 7f1f1eff7c00 0 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2917. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2918. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2919. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2920. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2921. 2020-08-27 14:41:23.084 7f1f1eff7c00 0 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2922. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2923. 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  2924. 2020-08-27 14:41:23.084 7f1f1eff7c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  2925. 2020-08-27 14:41:23.084 7f1f1eff7c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  2926. 2020-08-27 14:41:23.088 7f1f1eff7c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f1f1eff7c00 time 2020-08-27 14:41:23.091778
  2927. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  2928.  
  2929. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2930. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  2931. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2932. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2933. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2934. 5: (OSD::init()+0x3f3) [0x8f5483]
  2935. 6: (main()+0x27e2) [0x84c462]
  2936. 7: (__libc_start_main()+0xf0) [0x7f1f1c1a8830]
  2937. 8: (_start()+0x29) [0x880389]
  2938.  
  2939. 2020-08-27 14:41:23.092 7f1f1eff7c00 -1 *** Caught signal (Aborted) **
  2940. in thread 7f1f1eff7c00 thread_name:ceph-osd
  2941.  
  2942. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  2943. 1: (()+0x11390) [0x7f1f1cc92390]
  2944. 2: (gsignal()+0x38) [0x7f1f1c1bd428]
  2945. 3: (abort()+0x16a) [0x7f1f1c1bf02a]
  2946. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  2947. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  2948. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  2949. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  2950. 8: (OSD::init()+0x3f3) [0x8f5483]
  2951. 9: (main()+0x27e2) [0x84c462]
  2952. 10: (__libc_start_main()+0xf0) [0x7f1f1c1a8830]
  2953. 11: (_start()+0x29) [0x880389]
  2954. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  2955.  
  2956. --- begin dump of recent events ---
  2957. -77> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command assert hook 0xb928100
  2958. -76> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command abort hook 0xb928100
  2959. -75> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command perfcounters_dump hook 0xb928100
  2960. -74> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command 1 hook 0xb928100
  2961. -73> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command perf dump hook 0xb928100
  2962. -72> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command perfcounters_schema hook 0xb928100
  2963. -71> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command perf histogram dump hook 0xb928100
  2964. -70> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command 2 hook 0xb928100
  2965. -69> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command perf schema hook 0xb928100
  2966. -68> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command perf histogram schema hook 0xb928100
  2967. -67> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command perf reset hook 0xb928100
  2968. -66> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command config show hook 0xb928100
  2969. -65> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command config help hook 0xb928100
  2970. -64> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command config set hook 0xb928100
  2971. -63> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command config unset hook 0xb928100
  2972. -62> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command config get hook 0xb928100
  2973. -61> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command config diff hook 0xb928100
  2974. -60> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command config diff get hook 0xb928100
  2975. -59> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command log flush hook 0xb928100
  2976. -58> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command log dump hook 0xb928100
  2977. -57> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command log reopen hook 0xb928100
  2978. -56> 2020-08-27 14:41:21.640 7f1f1eff7c00 5 asok(0xb9ee000) register_command dump_mempools hook 0xc5e6068
  2979. -55> 2020-08-27 14:41:21.648 7f1f1eff7c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  2980. -54> 2020-08-27 14:41:21.648 7f1f1eff7c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3561108
  2981. -53> 2020-08-27 14:41:21.648 7f1f1eff7c00 0 pidfile_write: ignore empty --pid-file
  2982. -52> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2983. -51> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2984. -50> 2020-08-27 14:41:21.652 7f1f1eff7c00 0 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2985. -49> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2986. -48> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  2987. -47> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  2988. -46> 2020-08-27 14:41:21.652 7f1f1eff7c00 0 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  2989. -45> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2990. -44> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  2991. -43> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  2992. -42> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  2993. -41> 2020-08-27 14:41:21.652 7f1f1eff7c00 0 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  2994. -40> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2995. -39> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  2996. -38> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  2997. -37> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  2998. -36> 2020-08-27 14:41:21.652 7f1f1eff7c00 0 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  2999. -35> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3000. -34> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3001. -33> 2020-08-27 14:41:21.652 7f1f1eff7c00 1 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  3002. -32> 2020-08-27 14:41:21.964 7f1f1eff7c00 1 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block.db) close
  3003. -31> 2020-08-27 14:41:22.248 7f1f1eff7c00 1 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block) close
  3004. -30> 2020-08-27 14:41:22.484 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) close
  3005. -29> 2020-08-27 14:41:22.720 7f1f1eff7c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  3006. -28> 2020-08-27 14:41:22.732 7f1f1eff7c00 0 load: jerasure load: lrc load: isa
  3007. -27> 2020-08-27 14:41:22.732 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3008. -26> 2020-08-27 14:41:22.732 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3009. -25> 2020-08-27 14:41:22.732 7f1f1eff7c00 0 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3010. -24> 2020-08-27 14:41:22.732 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3011. -23> 2020-08-27 14:41:22.732 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) close
  3012. -22> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3013. -21> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3014. -20> 2020-08-27 14:41:23.084 7f1f1eff7c00 0 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3015. -19> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3016. -18> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3017. -17> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3018. -16> 2020-08-27 14:41:23.084 7f1f1eff7c00 0 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3019. -15> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3020. -14> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3021. -13> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3022. -12> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3023. -11> 2020-08-27 14:41:23.084 7f1f1eff7c00 0 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3024. -10> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3025. -9> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3026. -8> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3027. -7> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3028. -6> 2020-08-27 14:41:23.084 7f1f1eff7c00 0 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3029. -5> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bdev(0xc6e4a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3030. -4> 2020-08-27 14:41:23.084 7f1f1eff7c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3031. -3> 2020-08-27 14:41:23.084 7f1f1eff7c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  3032. -2> 2020-08-27 14:41:23.084 7f1f1eff7c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  3033. -1> 2020-08-27 14:41:23.088 7f1f1eff7c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f1f1eff7c00 time 2020-08-27 14:41:23.091778
  3034. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  3035.  
  3036. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3037. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  3038. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3039. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3040. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3041. 5: (OSD::init()+0x3f3) [0x8f5483]
  3042. 6: (main()+0x27e2) [0x84c462]
  3043. 7: (__libc_start_main()+0xf0) [0x7f1f1c1a8830]
  3044. 8: (_start()+0x29) [0x880389]
  3045.  
  3046. 0> 2020-08-27 14:41:23.092 7f1f1eff7c00 -1 *** Caught signal (Aborted) **
  3047. in thread 7f1f1eff7c00 thread_name:ceph-osd
  3048.  
  3049. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3050. 1: (()+0x11390) [0x7f1f1cc92390]
  3051. 2: (gsignal()+0x38) [0x7f1f1c1bd428]
  3052. 3: (abort()+0x16a) [0x7f1f1c1bf02a]
  3053. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  3054. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3055. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3056. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3057. 8: (OSD::init()+0x3f3) [0x8f5483]
  3058. 9: (main()+0x27e2) [0x84c462]
  3059. 10: (__libc_start_main()+0xf0) [0x7f1f1c1a8830]
  3060. 11: (_start()+0x29) [0x880389]
  3061. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  3062.  
  3063. --- logging levels ---
  3064. 0/ 5 none
  3065. 0/ 0 lockdep
  3066. 0/ 0 context
  3067. 0/ 0 crush
  3068. 1/ 5 mds
  3069. 1/ 5 mds_balancer
  3070. 1/ 5 mds_locker
  3071. 1/ 5 mds_log
  3072. 1/ 5 mds_log_expire
  3073. 1/ 5 mds_migrator
  3074. 0/ 0 buffer
  3075. 0/ 0 timer
  3076. 0/ 0 filer
  3077. 0/ 1 striper
  3078. 0/ 0 objecter
  3079. 0/ 0 rados
  3080. 0/ 0 rbd
  3081. 0/ 5 rbd_mirror
  3082. 0/ 5 rbd_replay
  3083. 0/ 0 journaler
  3084. 0/ 0 objectcacher
  3085. 0/ 0 client
  3086. 0/ 0 osd
  3087. 0/ 0 optracker
  3088. 0/ 0 objclass
  3089. 0/ 0 filestore
  3090. 0/ 0 journal
  3091. 0/ 0 ms
  3092. 0/ 0 mon
  3093. 0/ 0 monc
  3094. 0/ 0 paxos
  3095. 0/ 0 tp
  3096. 0/ 0 auth
  3097. 1/ 5 crypto
  3098. 0/ 0 finisher
  3099. 1/ 1 reserver
  3100. 0/ 0 heartbeatmap
  3101. 0/ 0 perfcounter
  3102. 0/ 0 rgw
  3103. 1/ 5 rgw_sync
  3104. 1/10 civetweb
  3105. 1/ 5 javaclient
  3106. 0/ 0 asok
  3107. 0/ 0 throttle
  3108. 0/ 0 refs
  3109. 1/ 5 xio
  3110. 1/ 5 compressor
  3111. 0/ 0 bluestore
  3112. 1/ 5 bluefs
  3113. 1/ 3 bdev
  3114. 1/ 5 kstore
  3115. 4/ 5 rocksdb
  3116. 4/ 5 leveldb
  3117. 4/ 5 memdb
  3118. 1/ 5 kinetic
  3119. 1/ 5 fuse
  3120. 1/ 5 mgr
  3121. 1/ 5 mgrc
  3122. 1/ 5 dpdk
  3123. 1/ 5 eventtrace
  3124. 1/ 5 prioritycache
  3125. -2/-2 (syslog threshold)
  3126. -1/-1 (stderr threshold)
  3127. max_recent 10000
  3128. max_new 1000
  3129. log_file /var/log/ceph/ceph-osd.108.log
  3130. --- end dump of recent events ---
  3131. 2020-08-27 14:41:23.652 7fb49827bc00 0 set uid:gid to 64045:64045 (ceph:ceph)
  3132. 2020-08-27 14:41:23.652 7fb49827bc00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3562243
  3133. 2020-08-27 14:41:23.652 7fb49827bc00 0 pidfile_write: ignore empty --pid-file
  3134. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3135. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3136. 2020-08-27 14:41:23.656 7fb49827bc00 0 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3137. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3138. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3139. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3140. 2020-08-27 14:41:23.656 7fb49827bc00 0 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3141. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3142. 2020-08-27 14:41:23.656 7fb49827bc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3143. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3144. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3145. 2020-08-27 14:41:23.656 7fb49827bc00 0 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3146. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3147. 2020-08-27 14:41:23.656 7fb49827bc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3148. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3149. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3150. 2020-08-27 14:41:23.656 7fb49827bc00 0 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3151. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3152. 2020-08-27 14:41:23.656 7fb49827bc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3153. 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  3154. 2020-08-27 14:41:23.968 7fb49827bc00 1 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block.db) close
  3155. 2020-08-27 14:41:24.208 7fb49827bc00 1 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block) close
  3156. 2020-08-27 14:41:24.472 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) close
  3157. 2020-08-27 14:41:24.724 7fb49827bc00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  3158. 2020-08-27 14:41:24.732 7fb49827bc00 0 load: jerasure load: lrc load: isa
  3159. 2020-08-27 14:41:24.732 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3160. 2020-08-27 14:41:24.732 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3161. 2020-08-27 14:41:24.732 7fb49827bc00 0 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3162. 2020-08-27 14:41:24.732 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3163. 2020-08-27 14:41:24.732 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) close
  3164. 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3165. 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3166. 2020-08-27 14:41:25.028 7fb49827bc00 0 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3167. 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3168. 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3169. 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3170. 2020-08-27 14:41:25.028 7fb49827bc00 0 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3171. 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3172. 2020-08-27 14:41:25.028 7fb49827bc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3173. 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3174. 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3175. 2020-08-27 14:41:25.028 7fb49827bc00 0 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3176. 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3177. 2020-08-27 14:41:25.028 7fb49827bc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3178. 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3179. 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3180. 2020-08-27 14:41:25.028 7fb49827bc00 0 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3181. 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3182. 2020-08-27 14:41:25.028 7fb49827bc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3183. 2020-08-27 14:41:25.028 7fb49827bc00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  3184. 2020-08-27 14:41:25.028 7fb49827bc00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  3185. 2020-08-27 14:41:25.032 7fb49827bc00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7fb49827bc00 time 2020-08-27 14:41:25.035966
  3186. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  3187.  
  3188. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3189. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  3190. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3191. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3192. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3193. 5: (OSD::init()+0x3f3) [0x8f5483]
  3194. 6: (main()+0x27e2) [0x84c462]
  3195. 7: (__libc_start_main()+0xf0) [0x7fb49542c830]
  3196. 8: (_start()+0x29) [0x880389]
  3197.  
  3198. 2020-08-27 14:41:25.036 7fb49827bc00 -1 *** Caught signal (Aborted) **
  3199. in thread 7fb49827bc00 thread_name:ceph-osd
  3200.  
  3201. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3202. 1: (()+0x11390) [0x7fb495f16390]
  3203. 2: (gsignal()+0x38) [0x7fb495441428]
  3204. 3: (abort()+0x16a) [0x7fb49544302a]
  3205. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  3206. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3207. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3208. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3209. 8: (OSD::init()+0x3f3) [0x8f5483]
  3210. 9: (main()+0x27e2) [0x84c462]
  3211. 10: (__libc_start_main()+0xf0) [0x7fb49542c830]
  3212. 11: (_start()+0x29) [0x880389]
  3213. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  3214.  
  3215. --- begin dump of recent events ---
  3216. -77> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command assert hook 0xc56a100
  3217. -76> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command abort hook 0xc56a100
  3218. -75> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command perfcounters_dump hook 0xc56a100
  3219. -74> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command 1 hook 0xc56a100
  3220. -73> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command perf dump hook 0xc56a100
  3221. -72> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command perfcounters_schema hook 0xc56a100
  3222. -71> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command perf histogram dump hook 0xc56a100
  3223. -70> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command 2 hook 0xc56a100
  3224. -69> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command perf schema hook 0xc56a100
  3225. -68> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command perf histogram schema hook 0xc56a100
  3226. -67> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command perf reset hook 0xc56a100
  3227. -66> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command config show hook 0xc56a100
  3228. -65> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command config help hook 0xc56a100
  3229. -64> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command config set hook 0xc56a100
  3230. -63> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command config unset hook 0xc56a100
  3231. -62> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command config get hook 0xc56a100
  3232. -61> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command config diff hook 0xc56a100
  3233. -60> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command config diff get hook 0xc56a100
  3234. -59> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command log flush hook 0xc56a100
  3235. -58> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command log dump hook 0xc56a100
  3236. -57> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command log reopen hook 0xc56a100
  3237. -56> 2020-08-27 14:41:23.640 7fb49827bc00 5 asok(0xc630000) register_command dump_mempools hook 0xd228068
  3238. -55> 2020-08-27 14:41:23.652 7fb49827bc00 0 set uid:gid to 64045:64045 (ceph:ceph)
  3239. -54> 2020-08-27 14:41:23.652 7fb49827bc00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3562243
  3240. -53> 2020-08-27 14:41:23.652 7fb49827bc00 0 pidfile_write: ignore empty --pid-file
  3241. -52> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3242. -51> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3243. -50> 2020-08-27 14:41:23.656 7fb49827bc00 0 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3244. -49> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3245. -48> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3246. -47> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3247. -46> 2020-08-27 14:41:23.656 7fb49827bc00 0 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3248. -45> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3249. -44> 2020-08-27 14:41:23.656 7fb49827bc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3250. -43> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3251. -42> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3252. -41> 2020-08-27 14:41:23.656 7fb49827bc00 0 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3253. -40> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3254. -39> 2020-08-27 14:41:23.656 7fb49827bc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3255. -38> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3256. -37> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3257. -36> 2020-08-27 14:41:23.656 7fb49827bc00 0 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3258. -35> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3259. -34> 2020-08-27 14:41:23.656 7fb49827bc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3260. -33> 2020-08-27 14:41:23.656 7fb49827bc00 1 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  3261. -32> 2020-08-27 14:41:23.968 7fb49827bc00 1 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block.db) close
  3262. -31> 2020-08-27 14:41:24.208 7fb49827bc00 1 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block) close
  3263. -30> 2020-08-27 14:41:24.472 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) close
  3264. -29> 2020-08-27 14:41:24.724 7fb49827bc00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  3265. -28> 2020-08-27 14:41:24.732 7fb49827bc00 0 load: jerasure load: lrc load: isa
  3266. -27> 2020-08-27 14:41:24.732 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3267. -26> 2020-08-27 14:41:24.732 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3268. -25> 2020-08-27 14:41:24.732 7fb49827bc00 0 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3269. -24> 2020-08-27 14:41:24.732 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3270. -23> 2020-08-27 14:41:24.732 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) close
  3271. -22> 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3272. -21> 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3273. -20> 2020-08-27 14:41:25.028 7fb49827bc00 0 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3274. -19> 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3275. -18> 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3276. -17> 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3277. -16> 2020-08-27 14:41:25.028 7fb49827bc00 0 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3278. -15> 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3279. -14> 2020-08-27 14:41:25.028 7fb49827bc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3280. -13> 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3281. -12> 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3282. -11> 2020-08-27 14:41:25.028 7fb49827bc00 0 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3283. -10> 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3284. -9> 2020-08-27 14:41:25.028 7fb49827bc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3285. -8> 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3286. -7> 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3287. -6> 2020-08-27 14:41:25.028 7fb49827bc00 0 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3288. -5> 2020-08-27 14:41:25.028 7fb49827bc00 1 bdev(0xd256a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3289. -4> 2020-08-27 14:41:25.028 7fb49827bc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3290. -3> 2020-08-27 14:41:25.028 7fb49827bc00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  3291. -2> 2020-08-27 14:41:25.028 7fb49827bc00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  3292. -1> 2020-08-27 14:41:25.032 7fb49827bc00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7fb49827bc00 time 2020-08-27 14:41:25.035966
  3293. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  3294.  
  3295. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3296. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  3297. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3298. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3299. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3300. 5: (OSD::init()+0x3f3) [0x8f5483]
  3301. 6: (main()+0x27e2) [0x84c462]
  3302. 7: (__libc_start_main()+0xf0) [0x7fb49542c830]
  3303. 8: (_start()+0x29) [0x880389]
  3304.  
  3305. 0> 2020-08-27 14:41:25.036 7fb49827bc00 -1 *** Caught signal (Aborted) **
  3306. in thread 7fb49827bc00 thread_name:ceph-osd
  3307.  
  3308. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3309. 1: (()+0x11390) [0x7fb495f16390]
  3310. 2: (gsignal()+0x38) [0x7fb495441428]
  3311. 3: (abort()+0x16a) [0x7fb49544302a]
  3312. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  3313. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3314. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3315. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3316. 8: (OSD::init()+0x3f3) [0x8f5483]
  3317. 9: (main()+0x27e2) [0x84c462]
  3318. 10: (__libc_start_main()+0xf0) [0x7fb49542c830]
  3319. 11: (_start()+0x29) [0x880389]
  3320. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  3321.  
  3322. --- logging levels ---
  3323. 0/ 5 none
  3324. 0/ 0 lockdep
  3325. 0/ 0 context
  3326. 0/ 0 crush
  3327. 1/ 5 mds
  3328. 1/ 5 mds_balancer
  3329. 1/ 5 mds_locker
  3330. 1/ 5 mds_log
  3331. 1/ 5 mds_log_expire
  3332. 1/ 5 mds_migrator
  3333. 0/ 0 buffer
  3334. 0/ 0 timer
  3335. 0/ 0 filer
  3336. 0/ 1 striper
  3337. 0/ 0 objecter
  3338. 0/ 0 rados
  3339. 0/ 0 rbd
  3340. 0/ 5 rbd_mirror
  3341. 0/ 5 rbd_replay
  3342. 0/ 0 journaler
  3343. 0/ 0 objectcacher
  3344. 0/ 0 client
  3345. 0/ 0 osd
  3346. 0/ 0 optracker
  3347. 0/ 0 objclass
  3348. 0/ 0 filestore
  3349. 0/ 0 journal
  3350. 0/ 0 ms
  3351. 0/ 0 mon
  3352. 0/ 0 monc
  3353. 0/ 0 paxos
  3354. 0/ 0 tp
  3355. 0/ 0 auth
  3356. 1/ 5 crypto
  3357. 0/ 0 finisher
  3358. 1/ 1 reserver
  3359. 0/ 0 heartbeatmap
  3360. 0/ 0 perfcounter
  3361. 0/ 0 rgw
  3362. 1/ 5 rgw_sync
  3363. 1/10 civetweb
  3364. 1/ 5 javaclient
  3365. 0/ 0 asok
  3366. 0/ 0 throttle
  3367. 0/ 0 refs
  3368. 1/ 5 xio
  3369. 1/ 5 compressor
  3370. 0/ 0 bluestore
  3371. 1/ 5 bluefs
  3372. 1/ 3 bdev
  3373. 1/ 5 kstore
  3374. 4/ 5 rocksdb
  3375. 4/ 5 leveldb
  3376. 4/ 5 memdb
  3377. 1/ 5 kinetic
  3378. 1/ 5 fuse
  3379. 1/ 5 mgr
  3380. 1/ 5 mgrc
  3381. 1/ 5 dpdk
  3382. 1/ 5 eventtrace
  3383. 1/ 5 prioritycache
  3384. -2/-2 (syslog threshold)
  3385. -1/-1 (stderr threshold)
  3386. max_recent 10000
  3387. max_new 1000
  3388. log_file /var/log/ceph/ceph-osd.108.log
  3389. --- end dump of recent events ---
  3390. 2020-08-27 14:41:25.545 7f9b4e7d1c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  3391. 2020-08-27 14:41:25.545 7f9b4e7d1c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3563273
  3392. 2020-08-27 14:41:25.545 7f9b4e7d1c00 0 pidfile_write: ignore empty --pid-file
  3393. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3394. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3395. 2020-08-27 14:41:25.549 7f9b4e7d1c00 0 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3396. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3397. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3398. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3399. 2020-08-27 14:41:25.549 7f9b4e7d1c00 0 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3400. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3401. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3402. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3403. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3404. 2020-08-27 14:41:25.549 7f9b4e7d1c00 0 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3405. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3406. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3407. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3408. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3409. 2020-08-27 14:41:25.549 7f9b4e7d1c00 0 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3410. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3411. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3412. 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  3413. 2020-08-27 14:41:26.005 7f9b4e7d1c00 1 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block.db) close
  3414. 2020-08-27 14:41:26.121 7f9b4e7d1c00 1 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block) close
  3415. 2020-08-27 14:41:26.393 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) close
  3416. 2020-08-27 14:41:26.637 7f9b4e7d1c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  3417. 2020-08-27 14:41:26.645 7f9b4e7d1c00 0 load: jerasure load: lrc load: isa
  3418. 2020-08-27 14:41:26.645 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3419. 2020-08-27 14:41:26.645 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3420. 2020-08-27 14:41:26.645 7f9b4e7d1c00 0 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3421. 2020-08-27 14:41:26.645 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3422. 2020-08-27 14:41:26.645 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) close
  3423. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3424. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3425. 2020-08-27 14:41:26.965 7f9b4e7d1c00 0 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3426. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3427. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3428. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3429. 2020-08-27 14:41:26.965 7f9b4e7d1c00 0 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3430. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3431. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3432. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3433. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3434. 2020-08-27 14:41:26.965 7f9b4e7d1c00 0 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3435. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3436. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3437. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3438. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3439. 2020-08-27 14:41:26.965 7f9b4e7d1c00 0 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3440. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3441. 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3442. 2020-08-27 14:41:26.965 7f9b4e7d1c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  3443. 2020-08-27 14:41:26.965 7f9b4e7d1c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  3444. 2020-08-27 14:41:26.969 7f9b4e7d1c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f9b4e7d1c00 time 2020-08-27 14:41:26.971980
  3445. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  3446.  
  3447. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3448. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  3449. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3450. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3451. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3452. 5: (OSD::init()+0x3f3) [0x8f5483]
  3453. 6: (main()+0x27e2) [0x84c462]
  3454. 7: (__libc_start_main()+0xf0) [0x7f9b4b982830]
  3455. 8: (_start()+0x29) [0x880389]
  3456.  
  3457. 2020-08-27 14:41:26.973 7f9b4e7d1c00 -1 *** Caught signal (Aborted) **
  3458. in thread 7f9b4e7d1c00 thread_name:ceph-osd
  3459.  
  3460. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3461. 1: (()+0x11390) [0x7f9b4c46c390]
  3462. 2: (gsignal()+0x38) [0x7f9b4b997428]
  3463. 3: (abort()+0x16a) [0x7f9b4b99902a]
  3464. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  3465. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3466. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3467. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3468. 8: (OSD::init()+0x3f3) [0x8f5483]
  3469. 9: (main()+0x27e2) [0x84c462]
  3470. 10: (__libc_start_main()+0xf0) [0x7f9b4b982830]
  3471. 11: (_start()+0x29) [0x880389]
  3472. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  3473.  
  3474. --- begin dump of recent events ---
  3475. -77> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command assert hook 0xbddc100
  3476. -76> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command abort hook 0xbddc100
  3477. -75> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command perfcounters_dump hook 0xbddc100
  3478. -74> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command 1 hook 0xbddc100
  3479. -73> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command perf dump hook 0xbddc100
  3480. -72> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command perfcounters_schema hook 0xbddc100
  3481. -71> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command perf histogram dump hook 0xbddc100
  3482. -70> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command 2 hook 0xbddc100
  3483. -69> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command perf schema hook 0xbddc100
  3484. -68> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command perf histogram schema hook 0xbddc100
  3485. -67> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command perf reset hook 0xbddc100
  3486. -66> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command config show hook 0xbddc100
  3487. -65> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command config help hook 0xbddc100
  3488. -64> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command config set hook 0xbddc100
  3489. -63> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command config unset hook 0xbddc100
  3490. -62> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command config get hook 0xbddc100
  3491. -61> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command config diff hook 0xbddc100
  3492. -60> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command config diff get hook 0xbddc100
  3493. -59> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command log flush hook 0xbddc100
  3494. -58> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command log dump hook 0xbddc100
  3495. -57> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command log reopen hook 0xbddc100
  3496. -56> 2020-08-27 14:41:25.533 7f9b4e7d1c00 5 asok(0xbea2000) register_command dump_mempools hook 0xca9a068
  3497. -55> 2020-08-27 14:41:25.545 7f9b4e7d1c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  3498. -54> 2020-08-27 14:41:25.545 7f9b4e7d1c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3563273
  3499. -53> 2020-08-27 14:41:25.545 7f9b4e7d1c00 0 pidfile_write: ignore empty --pid-file
  3500. -52> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3501. -51> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3502. -50> 2020-08-27 14:41:25.549 7f9b4e7d1c00 0 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3503. -49> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3504. -48> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3505. -47> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3506. -46> 2020-08-27 14:41:25.549 7f9b4e7d1c00 0 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3507. -45> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3508. -44> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3509. -43> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3510. -42> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3511. -41> 2020-08-27 14:41:25.549 7f9b4e7d1c00 0 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3512. -40> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3513. -39> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3514. -38> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3515. -37> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3516. -36> 2020-08-27 14:41:25.549 7f9b4e7d1c00 0 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3517. -35> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3518. -34> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3519. -33> 2020-08-27 14:41:25.549 7f9b4e7d1c00 1 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  3520. -32> 2020-08-27 14:41:26.005 7f9b4e7d1c00 1 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block.db) close
  3521. -31> 2020-08-27 14:41:26.121 7f9b4e7d1c00 1 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block) close
  3522. -30> 2020-08-27 14:41:26.393 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) close
  3523. -29> 2020-08-27 14:41:26.637 7f9b4e7d1c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  3524. -28> 2020-08-27 14:41:26.645 7f9b4e7d1c00 0 load: jerasure load: lrc load: isa
  3525. -27> 2020-08-27 14:41:26.645 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3526. -26> 2020-08-27 14:41:26.645 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3527. -25> 2020-08-27 14:41:26.645 7f9b4e7d1c00 0 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3528. -24> 2020-08-27 14:41:26.645 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3529. -23> 2020-08-27 14:41:26.645 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) close
  3530. -22> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3531. -21> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3532. -20> 2020-08-27 14:41:26.965 7f9b4e7d1c00 0 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3533. -19> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3534. -18> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3535. -17> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3536. -16> 2020-08-27 14:41:26.965 7f9b4e7d1c00 0 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3537. -15> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3538. -14> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3539. -13> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3540. -12> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3541. -11> 2020-08-27 14:41:26.965 7f9b4e7d1c00 0 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3542. -10> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacc700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3543. -9> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3544. -8> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3545. -7> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3546. -6> 2020-08-27 14:41:26.965 7f9b4e7d1c00 0 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3547. -5> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bdev(0xcacca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3548. -4> 2020-08-27 14:41:26.965 7f9b4e7d1c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3549. -3> 2020-08-27 14:41:26.965 7f9b4e7d1c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  3550. -2> 2020-08-27 14:41:26.965 7f9b4e7d1c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  3551. -1> 2020-08-27 14:41:26.969 7f9b4e7d1c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f9b4e7d1c00 time 2020-08-27 14:41:26.971980
  3552. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  3553.  
  3554. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3555. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  3556. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3557. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3558. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3559. 5: (OSD::init()+0x3f3) [0x8f5483]
  3560. 6: (main()+0x27e2) [0x84c462]
  3561. 7: (__libc_start_main()+0xf0) [0x7f9b4b982830]
  3562. 8: (_start()+0x29) [0x880389]
  3563.  
  3564. 0> 2020-08-27 14:41:26.973 7f9b4e7d1c00 -1 *** Caught signal (Aborted) **
  3565. in thread 7f9b4e7d1c00 thread_name:ceph-osd
  3566.  
  3567. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3568. 1: (()+0x11390) [0x7f9b4c46c390]
  3569. 2: (gsignal()+0x38) [0x7f9b4b997428]
  3570. 3: (abort()+0x16a) [0x7f9b4b99902a]
  3571. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  3572. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3573. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3574. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3575. 8: (OSD::init()+0x3f3) [0x8f5483]
  3576. 9: (main()+0x27e2) [0x84c462]
  3577. 10: (__libc_start_main()+0xf0) [0x7f9b4b982830]
  3578. 11: (_start()+0x29) [0x880389]
  3579. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  3580.  
  3581. --- logging levels ---
  3582. 0/ 5 none
  3583. 0/ 0 lockdep
  3584. 0/ 0 context
  3585. 0/ 0 crush
  3586. 1/ 5 mds
  3587. 1/ 5 mds_balancer
  3588. 1/ 5 mds_locker
  3589. 1/ 5 mds_log
  3590. 1/ 5 mds_log_expire
  3591. 1/ 5 mds_migrator
  3592. 0/ 0 buffer
  3593. 0/ 0 timer
  3594. 0/ 0 filer
  3595. 0/ 1 striper
  3596. 0/ 0 objecter
  3597. 0/ 0 rados
  3598. 0/ 0 rbd
  3599. 0/ 5 rbd_mirror
  3600. 0/ 5 rbd_replay
  3601. 0/ 0 journaler
  3602. 0/ 0 objectcacher
  3603. 0/ 0 client
  3604. 0/ 0 osd
  3605. 0/ 0 optracker
  3606. 0/ 0 objclass
  3607. 0/ 0 filestore
  3608. 0/ 0 journal
  3609. 0/ 0 ms
  3610. 0/ 0 mon
  3611. 0/ 0 monc
  3612. 0/ 0 paxos
  3613. 0/ 0 tp
  3614. 0/ 0 auth
  3615. 1/ 5 crypto
  3616. 0/ 0 finisher
  3617. 1/ 1 reserver
  3618. 0/ 0 heartbeatmap
  3619. 0/ 0 perfcounter
  3620. 0/ 0 rgw
  3621. 1/ 5 rgw_sync
  3622. 1/10 civetweb
  3623. 1/ 5 javaclient
  3624. 0/ 0 asok
  3625. 0/ 0 throttle
  3626. 0/ 0 refs
  3627. 1/ 5 xio
  3628. 1/ 5 compressor
  3629. 0/ 0 bluestore
  3630. 1/ 5 bluefs
  3631. 1/ 3 bdev
  3632. 1/ 5 kstore
  3633. 4/ 5 rocksdb
  3634. 4/ 5 leveldb
  3635. 4/ 5 memdb
  3636. 1/ 5 kinetic
  3637. 1/ 5 fuse
  3638. 1/ 5 mgr
  3639. 1/ 5 mgrc
  3640. 1/ 5 dpdk
  3641. 1/ 5 eventtrace
  3642. 1/ 5 prioritycache
  3643. -2/-2 (syslog threshold)
  3644. -1/-1 (stderr threshold)
  3645. max_recent 10000
  3646. max_new 1000
  3647. log_file /var/log/ceph/ceph-osd.108.log
  3648. --- end dump of recent events ---
  3649. 2020-08-27 14:41:27.489 7fa590e47c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  3650. 2020-08-27 14:41:27.489 7fa590e47c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3564353
  3651. 2020-08-27 14:41:27.489 7fa590e47c00 0 pidfile_write: ignore empty --pid-file
  3652. 2020-08-27 14:41:27.513 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3653. 2020-08-27 14:41:27.513 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3654. 2020-08-27 14:41:27.513 7fa590e47c00 0 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3655. 2020-08-27 14:41:27.513 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3656. 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3657. 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3658. 2020-08-27 14:41:27.517 7fa590e47c00 0 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3659. 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3660. 2020-08-27 14:41:27.517 7fa590e47c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3661. 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3662. 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3663. 2020-08-27 14:41:27.517 7fa590e47c00 0 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3664. 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3665. 2020-08-27 14:41:27.517 7fa590e47c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3666. 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3667. 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3668. 2020-08-27 14:41:27.517 7fa590e47c00 0 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3669. 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3670. 2020-08-27 14:41:27.517 7fa590e47c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3671. 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  3672. 2020-08-27 14:41:27.569 7fa590e47c00 1 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block.db) close
  3673. 2020-08-27 14:41:27.829 7fa590e47c00 1 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block) close
  3674. 2020-08-27 14:41:28.093 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) close
  3675. 2020-08-27 14:41:28.393 7fa590e47c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  3676. 2020-08-27 14:41:28.405 7fa590e47c00 0 load: jerasure load: lrc load: isa
  3677. 2020-08-27 14:41:28.405 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3678. 2020-08-27 14:41:28.405 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3679. 2020-08-27 14:41:28.405 7fa590e47c00 0 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3680. 2020-08-27 14:41:28.405 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3681. 2020-08-27 14:41:28.405 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) close
  3682. 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3683. 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3684. 2020-08-27 14:41:28.701 7fa590e47c00 0 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3685. 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3686. 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3687. 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3688. 2020-08-27 14:41:28.701 7fa590e47c00 0 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3689. 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3690. 2020-08-27 14:41:28.701 7fa590e47c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3691. 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3692. 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3693. 2020-08-27 14:41:28.701 7fa590e47c00 0 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3694. 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3695. 2020-08-27 14:41:28.701 7fa590e47c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3696. 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3697. 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3698. 2020-08-27 14:41:28.701 7fa590e47c00 0 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3699. 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3700. 2020-08-27 14:41:28.701 7fa590e47c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3701. 2020-08-27 14:41:28.701 7fa590e47c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  3702. 2020-08-27 14:41:28.701 7fa590e47c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  3703. 2020-08-27 14:41:28.705 7fa590e47c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7fa590e47c00 time 2020-08-27 14:41:28.707612
  3704. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  3705.  
  3706. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3707. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  3708. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3709. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3710. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3711. 5: (OSD::init()+0x3f3) [0x8f5483]
  3712. 6: (main()+0x27e2) [0x84c462]
  3713. 7: (__libc_start_main()+0xf0) [0x7fa58dff8830]
  3714. 8: (_start()+0x29) [0x880389]
  3715.  
  3716. 2020-08-27 14:41:28.709 7fa590e47c00 -1 *** Caught signal (Aborted) **
  3717. in thread 7fa590e47c00 thread_name:ceph-osd
  3718.  
  3719. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3720. 1: (()+0x11390) [0x7fa58eae2390]
  3721. 2: (gsignal()+0x38) [0x7fa58e00d428]
  3722. 3: (abort()+0x16a) [0x7fa58e00f02a]
  3723. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  3724. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3725. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3726. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3727. 8: (OSD::init()+0x3f3) [0x8f5483]
  3728. 9: (main()+0x27e2) [0x84c462]
  3729. 10: (__libc_start_main()+0xf0) [0x7fa58dff8830]
  3730. 11: (_start()+0x29) [0x880389]
  3731. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  3732.  
  3733. --- begin dump of recent events ---
  3734. -77> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command assert hook 0xc188100
  3735. -76> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command abort hook 0xc188100
  3736. -75> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command perfcounters_dump hook 0xc188100
  3737. -74> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command 1 hook 0xc188100
  3738. -73> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command perf dump hook 0xc188100
  3739. -72> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command perfcounters_schema hook 0xc188100
  3740. -71> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command perf histogram dump hook 0xc188100
  3741. -70> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command 2 hook 0xc188100
  3742. -69> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command perf schema hook 0xc188100
  3743. -68> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command perf histogram schema hook 0xc188100
  3744. -67> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command perf reset hook 0xc188100
  3745. -66> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command config show hook 0xc188100
  3746. -65> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command config help hook 0xc188100
  3747. -64> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command config set hook 0xc188100
  3748. -63> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command config unset hook 0xc188100
  3749. -62> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command config get hook 0xc188100
  3750. -61> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command config diff hook 0xc188100
  3751. -60> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command config diff get hook 0xc188100
  3752. -59> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command log flush hook 0xc188100
  3753. -58> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command log dump hook 0xc188100
  3754. -57> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command log reopen hook 0xc188100
  3755. -56> 2020-08-27 14:41:27.477 7fa590e47c00 5 asok(0xc24e000) register_command dump_mempools hook 0xce46068
  3756. -55> 2020-08-27 14:41:27.489 7fa590e47c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  3757. -54> 2020-08-27 14:41:27.489 7fa590e47c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3564353
  3758. -53> 2020-08-27 14:41:27.489 7fa590e47c00 0 pidfile_write: ignore empty --pid-file
  3759. -52> 2020-08-27 14:41:27.513 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3760. -51> 2020-08-27 14:41:27.513 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3761. -50> 2020-08-27 14:41:27.513 7fa590e47c00 0 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3762. -49> 2020-08-27 14:41:27.513 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3763. -48> 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3764. -47> 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3765. -46> 2020-08-27 14:41:27.517 7fa590e47c00 0 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3766. -45> 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3767. -44> 2020-08-27 14:41:27.517 7fa590e47c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3768. -43> 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3769. -42> 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3770. -41> 2020-08-27 14:41:27.517 7fa590e47c00 0 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3771. -40> 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3772. -39> 2020-08-27 14:41:27.517 7fa590e47c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3773. -38> 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3774. -37> 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3775. -36> 2020-08-27 14:41:27.517 7fa590e47c00 0 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3776. -35> 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3777. -34> 2020-08-27 14:41:27.517 7fa590e47c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3778. -33> 2020-08-27 14:41:27.517 7fa590e47c00 1 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  3779. -32> 2020-08-27 14:41:27.569 7fa590e47c00 1 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block.db) close
  3780. -31> 2020-08-27 14:41:27.829 7fa590e47c00 1 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block) close
  3781. -30> 2020-08-27 14:41:28.093 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) close
  3782. -29> 2020-08-27 14:41:28.393 7fa590e47c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  3783. -28> 2020-08-27 14:41:28.405 7fa590e47c00 0 load: jerasure load: lrc load: isa
  3784. -27> 2020-08-27 14:41:28.405 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3785. -26> 2020-08-27 14:41:28.405 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3786. -25> 2020-08-27 14:41:28.405 7fa590e47c00 0 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3787. -24> 2020-08-27 14:41:28.405 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3788. -23> 2020-08-27 14:41:28.405 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) close
  3789. -22> 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3790. -21> 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3791. -20> 2020-08-27 14:41:28.701 7fa590e47c00 0 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3792. -19> 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3793. -18> 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3794. -17> 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3795. -16> 2020-08-27 14:41:28.701 7fa590e47c00 0 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3796. -15> 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3797. -14> 2020-08-27 14:41:28.701 7fa590e47c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3798. -13> 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3799. -12> 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3800. -11> 2020-08-27 14:41:28.701 7fa590e47c00 0 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3801. -10> 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3802. -9> 2020-08-27 14:41:28.701 7fa590e47c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3803. -8> 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3804. -7> 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3805. -6> 2020-08-27 14:41:28.701 7fa590e47c00 0 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3806. -5> 2020-08-27 14:41:28.701 7fa590e47c00 1 bdev(0xcf48a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3807. -4> 2020-08-27 14:41:28.701 7fa590e47c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3808. -3> 2020-08-27 14:41:28.701 7fa590e47c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  3809. -2> 2020-08-27 14:41:28.701 7fa590e47c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  3810. -1> 2020-08-27 14:41:28.705 7fa590e47c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7fa590e47c00 time 2020-08-27 14:41:28.707612
  3811. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  3812.  
  3813. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3814. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  3815. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3816. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3817. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3818. 5: (OSD::init()+0x3f3) [0x8f5483]
  3819. 6: (main()+0x27e2) [0x84c462]
  3820. 7: (__libc_start_main()+0xf0) [0x7fa58dff8830]
  3821. 8: (_start()+0x29) [0x880389]
  3822.  
  3823. 0> 2020-08-27 14:41:28.709 7fa590e47c00 -1 *** Caught signal (Aborted) **
  3824. in thread 7fa590e47c00 thread_name:ceph-osd
  3825.  
  3826. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3827. 1: (()+0x11390) [0x7fa58eae2390]
  3828. 2: (gsignal()+0x38) [0x7fa58e00d428]
  3829. 3: (abort()+0x16a) [0x7fa58e00f02a]
  3830. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  3831. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3832. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3833. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3834. 8: (OSD::init()+0x3f3) [0x8f5483]
  3835. 9: (main()+0x27e2) [0x84c462]
  3836. 10: (__libc_start_main()+0xf0) [0x7fa58dff8830]
  3837. 11: (_start()+0x29) [0x880389]
  3838. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  3839.  
  3840. --- logging levels ---
  3841. 0/ 5 none
  3842. 0/ 0 lockdep
  3843. 0/ 0 context
  3844. 0/ 0 crush
  3845. 1/ 5 mds
  3846. 1/ 5 mds_balancer
  3847. 1/ 5 mds_locker
  3848. 1/ 5 mds_log
  3849. 1/ 5 mds_log_expire
  3850. 1/ 5 mds_migrator
  3851. 0/ 0 buffer
  3852. 0/ 0 timer
  3853. 0/ 0 filer
  3854. 0/ 1 striper
  3855. 0/ 0 objecter
  3856. 0/ 0 rados
  3857. 0/ 0 rbd
  3858. 0/ 5 rbd_mirror
  3859. 0/ 5 rbd_replay
  3860. 0/ 0 journaler
  3861. 0/ 0 objectcacher
  3862. 0/ 0 client
  3863. 0/ 0 osd
  3864. 0/ 0 optracker
  3865. 0/ 0 objclass
  3866. 0/ 0 filestore
  3867. 0/ 0 journal
  3868. 0/ 0 ms
  3869. 0/ 0 mon
  3870. 0/ 0 monc
  3871. 0/ 0 paxos
  3872. 0/ 0 tp
  3873. 0/ 0 auth
  3874. 1/ 5 crypto
  3875. 0/ 0 finisher
  3876. 1/ 1 reserver
  3877. 0/ 0 heartbeatmap
  3878. 0/ 0 perfcounter
  3879. 0/ 0 rgw
  3880. 1/ 5 rgw_sync
  3881. 1/10 civetweb
  3882. 1/ 5 javaclient
  3883. 0/ 0 asok
  3884. 0/ 0 throttle
  3885. 0/ 0 refs
  3886. 1/ 5 xio
  3887. 1/ 5 compressor
  3888. 0/ 0 bluestore
  3889. 1/ 5 bluefs
  3890. 1/ 3 bdev
  3891. 1/ 5 kstore
  3892. 4/ 5 rocksdb
  3893. 4/ 5 leveldb
  3894. 4/ 5 memdb
  3895. 1/ 5 kinetic
  3896. 1/ 5 fuse
  3897. 1/ 5 mgr
  3898. 1/ 5 mgrc
  3899. 1/ 5 dpdk
  3900. 1/ 5 eventtrace
  3901. 1/ 5 prioritycache
  3902. -2/-2 (syslog threshold)
  3903. -1/-1 (stderr threshold)
  3904. max_recent 10000
  3905. max_new 1000
  3906. log_file /var/log/ceph/ceph-osd.108.log
  3907. --- end dump of recent events ---
  3908. 2020-08-27 14:41:29.265 7f49624ebc00 0 set uid:gid to 64045:64045 (ceph:ceph)
  3909. 2020-08-27 14:41:29.265 7f49624ebc00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3565331
  3910. 2020-08-27 14:41:29.265 7f49624ebc00 0 pidfile_write: ignore empty --pid-file
  3911. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3912. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3913. 2020-08-27 14:41:29.269 7f49624ebc00 0 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3914. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3915. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3916. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3917. 2020-08-27 14:41:29.269 7f49624ebc00 0 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3918. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3919. 2020-08-27 14:41:29.269 7f49624ebc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3920. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3921. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3922. 2020-08-27 14:41:29.269 7f49624ebc00 0 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3923. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3924. 2020-08-27 14:41:29.269 7f49624ebc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3925. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3926. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3927. 2020-08-27 14:41:29.269 7f49624ebc00 0 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3928. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3929. 2020-08-27 14:41:29.269 7f49624ebc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3930. 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  3931. 2020-08-27 14:41:29.641 7f49624ebc00 1 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block.db) close
  3932. 2020-08-27 14:41:29.849 7f49624ebc00 1 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block) close
  3933. 2020-08-27 14:41:30.057 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) close
  3934. 2020-08-27 14:41:30.349 7f49624ebc00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  3935. 2020-08-27 14:41:30.361 7f49624ebc00 0 load: jerasure load: lrc load: isa
  3936. 2020-08-27 14:41:30.361 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3937. 2020-08-27 14:41:30.361 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3938. 2020-08-27 14:41:30.361 7f49624ebc00 0 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3939. 2020-08-27 14:41:30.361 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3940. 2020-08-27 14:41:30.373 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) close
  3941. 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3942. 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3943. 2020-08-27 14:41:30.641 7f49624ebc00 0 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3944. 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3945. 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  3946. 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  3947. 2020-08-27 14:41:30.641 7f49624ebc00 0 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  3948. 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3949. 2020-08-27 14:41:30.641 7f49624ebc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  3950. 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  3951. 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  3952. 2020-08-27 14:41:30.641 7f49624ebc00 0 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  3953. 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3954. 2020-08-27 14:41:30.641 7f49624ebc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  3955. 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  3956. 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  3957. 2020-08-27 14:41:30.641 7f49624ebc00 0 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  3958. 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3959. 2020-08-27 14:41:30.641 7f49624ebc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  3960. 2020-08-27 14:41:30.641 7f49624ebc00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  3961. 2020-08-27 14:41:30.641 7f49624ebc00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  3962. 2020-08-27 14:41:30.645 7f49624ebc00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f49624ebc00 time 2020-08-27 14:41:30.647666
  3963. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  3964.  
  3965. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3966. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  3967. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3968. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3969. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3970. 5: (OSD::init()+0x3f3) [0x8f5483]
  3971. 6: (main()+0x27e2) [0x84c462]
  3972. 7: (__libc_start_main()+0xf0) [0x7f495f69c830]
  3973. 8: (_start()+0x29) [0x880389]
  3974.  
  3975. 2020-08-27 14:41:30.649 7f49624ebc00 -1 *** Caught signal (Aborted) **
  3976. in thread 7f49624ebc00 thread_name:ceph-osd
  3977.  
  3978. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  3979. 1: (()+0x11390) [0x7f4960186390]
  3980. 2: (gsignal()+0x38) [0x7f495f6b1428]
  3981. 3: (abort()+0x16a) [0x7f495f6b302a]
  3982. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  3983. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  3984. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  3985. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  3986. 8: (OSD::init()+0x3f3) [0x8f5483]
  3987. 9: (main()+0x27e2) [0x84c462]
  3988. 10: (__libc_start_main()+0xf0) [0x7f495f69c830]
  3989. 11: (_start()+0x29) [0x880389]
  3990. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  3991.  
  3992. --- begin dump of recent events ---
  3993. -77> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command assert hook 0xc6f2100
  3994. -76> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command abort hook 0xc6f2100
  3995. -75> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command perfcounters_dump hook 0xc6f2100
  3996. -74> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command 1 hook 0xc6f2100
  3997. -73> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command perf dump hook 0xc6f2100
  3998. -72> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command perfcounters_schema hook 0xc6f2100
  3999. -71> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command perf histogram dump hook 0xc6f2100
  4000. -70> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command 2 hook 0xc6f2100
  4001. -69> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command perf schema hook 0xc6f2100
  4002. -68> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command perf histogram schema hook 0xc6f2100
  4003. -67> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command perf reset hook 0xc6f2100
  4004. -66> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command config show hook 0xc6f2100
  4005. -65> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command config help hook 0xc6f2100
  4006. -64> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command config set hook 0xc6f2100
  4007. -63> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command config unset hook 0xc6f2100
  4008. -62> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command config get hook 0xc6f2100
  4009. -61> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command config diff hook 0xc6f2100
  4010. -60> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command config diff get hook 0xc6f2100
  4011. -59> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command log flush hook 0xc6f2100
  4012. -58> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command log dump hook 0xc6f2100
  4013. -57> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command log reopen hook 0xc6f2100
  4014. -56> 2020-08-27 14:41:29.253 7f49624ebc00 5 asok(0xc7b8000) register_command dump_mempools hook 0xd3b0068
  4015. -55> 2020-08-27 14:41:29.265 7f49624ebc00 0 set uid:gid to 64045:64045 (ceph:ceph)
  4016. -54> 2020-08-27 14:41:29.265 7f49624ebc00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3565331
  4017. -53> 2020-08-27 14:41:29.265 7f49624ebc00 0 pidfile_write: ignore empty --pid-file
  4018. -52> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4019. -51> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4020. -50> 2020-08-27 14:41:29.269 7f49624ebc00 0 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4021. -49> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4022. -48> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4023. -47> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4024. -46> 2020-08-27 14:41:29.269 7f49624ebc00 0 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4025. -45> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4026. -44> 2020-08-27 14:41:29.269 7f49624ebc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4027. -43> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4028. -42> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4029. -41> 2020-08-27 14:41:29.269 7f49624ebc00 0 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4030. -40> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4031. -39> 2020-08-27 14:41:29.269 7f49624ebc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4032. -38> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4033. -37> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4034. -36> 2020-08-27 14:41:29.269 7f49624ebc00 0 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4035. -35> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4036. -34> 2020-08-27 14:41:29.269 7f49624ebc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4037. -33> 2020-08-27 14:41:29.269 7f49624ebc00 1 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  4038. -32> 2020-08-27 14:41:29.641 7f49624ebc00 1 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block.db) close
  4039. -31> 2020-08-27 14:41:29.849 7f49624ebc00 1 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block) close
  4040. -30> 2020-08-27 14:41:30.057 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) close
  4041. -29> 2020-08-27 14:41:30.349 7f49624ebc00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  4042. -28> 2020-08-27 14:41:30.361 7f49624ebc00 0 load: jerasure load: lrc load: isa
  4043. -27> 2020-08-27 14:41:30.361 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4044. -26> 2020-08-27 14:41:30.361 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4045. -25> 2020-08-27 14:41:30.361 7f49624ebc00 0 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4046. -24> 2020-08-27 14:41:30.361 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4047. -23> 2020-08-27 14:41:30.373 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) close
  4048. -22> 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4049. -21> 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4050. -20> 2020-08-27 14:41:30.641 7f49624ebc00 0 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4051. -19> 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4052. -18> 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4053. -17> 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4054. -16> 2020-08-27 14:41:30.641 7f49624ebc00 0 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4055. -15> 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4056. -14> 2020-08-27 14:41:30.641 7f49624ebc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4057. -13> 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4058. -12> 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4059. -11> 2020-08-27 14:41:30.641 7f49624ebc00 0 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4060. -10> 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4061. -9> 2020-08-27 14:41:30.641 7f49624ebc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4062. -8> 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4063. -7> 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4064. -6> 2020-08-27 14:41:30.641 7f49624ebc00 0 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4065. -5> 2020-08-27 14:41:30.641 7f49624ebc00 1 bdev(0xd4b2a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4066. -4> 2020-08-27 14:41:30.641 7f49624ebc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4067. -3> 2020-08-27 14:41:30.641 7f49624ebc00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  4068. -2> 2020-08-27 14:41:30.641 7f49624ebc00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  4069. -1> 2020-08-27 14:41:30.645 7f49624ebc00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f49624ebc00 time 2020-08-27 14:41:30.647666
  4070. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  4071.  
  4072. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4073. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  4074. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4075. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4076. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4077. 5: (OSD::init()+0x3f3) [0x8f5483]
  4078. 6: (main()+0x27e2) [0x84c462]
  4079. 7: (__libc_start_main()+0xf0) [0x7f495f69c830]
  4080. 8: (_start()+0x29) [0x880389]
  4081.  
  4082. 0> 2020-08-27 14:41:30.649 7f49624ebc00 -1 *** Caught signal (Aborted) **
  4083. in thread 7f49624ebc00 thread_name:ceph-osd
  4084.  
  4085. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4086. 1: (()+0x11390) [0x7f4960186390]
  4087. 2: (gsignal()+0x38) [0x7f495f6b1428]
  4088. 3: (abort()+0x16a) [0x7f495f6b302a]
  4089. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  4090. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4091. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4092. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4093. 8: (OSD::init()+0x3f3) [0x8f5483]
  4094. 9: (main()+0x27e2) [0x84c462]
  4095. 10: (__libc_start_main()+0xf0) [0x7f495f69c830]
  4096. 11: (_start()+0x29) [0x880389]
  4097. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  4098.  
  4099. --- logging levels ---
  4100. 0/ 5 none
  4101. 0/ 0 lockdep
  4102. 0/ 0 context
  4103. 0/ 0 crush
  4104. 1/ 5 mds
  4105. 1/ 5 mds_balancer
  4106. 1/ 5 mds_locker
  4107. 1/ 5 mds_log
  4108. 1/ 5 mds_log_expire
  4109. 1/ 5 mds_migrator
  4110. 0/ 0 buffer
  4111. 0/ 0 timer
  4112. 0/ 0 filer
  4113. 0/ 1 striper
  4114. 0/ 0 objecter
  4115. 0/ 0 rados
  4116. 0/ 0 rbd
  4117. 0/ 5 rbd_mirror
  4118. 0/ 5 rbd_replay
  4119. 0/ 0 journaler
  4120. 0/ 0 objectcacher
  4121. 0/ 0 client
  4122. 0/ 0 osd
  4123. 0/ 0 optracker
  4124. 0/ 0 objclass
  4125. 0/ 0 filestore
  4126. 0/ 0 journal
  4127. 0/ 0 ms
  4128. 0/ 0 mon
  4129. 0/ 0 monc
  4130. 0/ 0 paxos
  4131. 0/ 0 tp
  4132. 0/ 0 auth
  4133. 1/ 5 crypto
  4134. 0/ 0 finisher
  4135. 1/ 1 reserver
  4136. 0/ 0 heartbeatmap
  4137. 0/ 0 perfcounter
  4138. 0/ 0 rgw
  4139. 1/ 5 rgw_sync
  4140. 1/10 civetweb
  4141. 1/ 5 javaclient
  4142. 0/ 0 asok
  4143. 0/ 0 throttle
  4144. 0/ 0 refs
  4145. 1/ 5 xio
  4146. 1/ 5 compressor
  4147. 0/ 0 bluestore
  4148. 1/ 5 bluefs
  4149. 1/ 3 bdev
  4150. 1/ 5 kstore
  4151. 4/ 5 rocksdb
  4152. 4/ 5 leveldb
  4153. 4/ 5 memdb
  4154. 1/ 5 kinetic
  4155. 1/ 5 fuse
  4156. 1/ 5 mgr
  4157. 1/ 5 mgrc
  4158. 1/ 5 dpdk
  4159. 1/ 5 eventtrace
  4160. 1/ 5 prioritycache
  4161. -2/-2 (syslog threshold)
  4162. -1/-1 (stderr threshold)
  4163. max_recent 10000
  4164. max_new 1000
  4165. log_file /var/log/ceph/ceph-osd.108.log
  4166. --- end dump of recent events ---
  4167. 2020-08-27 14:41:31.177 7f6e1982cc00 0 set uid:gid to 64045:64045 (ceph:ceph)
  4168. 2020-08-27 14:41:31.177 7f6e1982cc00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3566439
  4169. 2020-08-27 14:41:31.177 7f6e1982cc00 0 pidfile_write: ignore empty --pid-file
  4170. 2020-08-27 14:41:31.177 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4171. 2020-08-27 14:41:31.177 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4172. 2020-08-27 14:41:31.177 7f6e1982cc00 0 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4173. 2020-08-27 14:41:31.177 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4174. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4175. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4176. 2020-08-27 14:41:31.181 7f6e1982cc00 0 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4177. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4178. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4179. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4180. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4181. 2020-08-27 14:41:31.181 7f6e1982cc00 0 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4182. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4183. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4184. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4185. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4186. 2020-08-27 14:41:31.181 7f6e1982cc00 0 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4187. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4188. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4189. 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  4190. 2020-08-27 14:41:31.525 7f6e1982cc00 1 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block.db) close
  4191. 2020-08-27 14:41:31.781 7f6e1982cc00 1 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block) close
  4192. 2020-08-27 14:41:32.017 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) close
  4193. 2020-08-27 14:41:32.257 7f6e1982cc00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  4194. 2020-08-27 14:41:32.265 7f6e1982cc00 0 load: jerasure load: lrc load: isa
  4195. 2020-08-27 14:41:32.265 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4196. 2020-08-27 14:41:32.265 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4197. 2020-08-27 14:41:32.265 7f6e1982cc00 0 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4198. 2020-08-27 14:41:32.265 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4199. 2020-08-27 14:41:32.265 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) close
  4200. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4201. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4202. 2020-08-27 14:41:32.601 7f6e1982cc00 0 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4203. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4204. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4205. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4206. 2020-08-27 14:41:32.601 7f6e1982cc00 0 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4207. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4208. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4209. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4210. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4211. 2020-08-27 14:41:32.601 7f6e1982cc00 0 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4212. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4213. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4214. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4215. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4216. 2020-08-27 14:41:32.601 7f6e1982cc00 0 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4217. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4218. 2020-08-27 14:41:32.601 7f6e1982cc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4219. 2020-08-27 14:41:32.601 7f6e1982cc00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  4220. 2020-08-27 14:41:32.601 7f6e1982cc00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  4221. 2020-08-27 14:41:32.605 7f6e1982cc00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f6e1982cc00 time 2020-08-27 14:41:32.608408
  4222. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  4223.  
  4224. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4225. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  4226. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4227. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4228. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4229. 5: (OSD::init()+0x3f3) [0x8f5483]
  4230. 6: (main()+0x27e2) [0x84c462]
  4231. 7: (__libc_start_main()+0xf0) [0x7f6e169dd830]
  4232. 8: (_start()+0x29) [0x880389]
  4233.  
  4234. 2020-08-27 14:41:32.609 7f6e1982cc00 -1 *** Caught signal (Aborted) **
  4235. in thread 7f6e1982cc00 thread_name:ceph-osd
  4236.  
  4237. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4238. 1: (()+0x11390) [0x7f6e174c7390]
  4239. 2: (gsignal()+0x38) [0x7f6e169f2428]
  4240. 3: (abort()+0x16a) [0x7f6e169f402a]
  4241. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  4242. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4243. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4244. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4245. 8: (OSD::init()+0x3f3) [0x8f5483]
  4246. 9: (main()+0x27e2) [0x84c462]
  4247. 10: (__libc_start_main()+0xf0) [0x7f6e169dd830]
  4248. 11: (_start()+0x29) [0x880389]
  4249. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  4250.  
  4251. --- begin dump of recent events ---
  4252. -77> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command assert hook 0xb560100
  4253. -76> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command abort hook 0xb560100
  4254. -75> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command perfcounters_dump hook 0xb560100
  4255. -74> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command 1 hook 0xb560100
  4256. -73> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command perf dump hook 0xb560100
  4257. -72> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command perfcounters_schema hook 0xb560100
  4258. -71> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command perf histogram dump hook 0xb560100
  4259. -70> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command 2 hook 0xb560100
  4260. -69> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command perf schema hook 0xb560100
  4261. -68> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command perf histogram schema hook 0xb560100
  4262. -67> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command perf reset hook 0xb560100
  4263. -66> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command config show hook 0xb560100
  4264. -65> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command config help hook 0xb560100
  4265. -64> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command config set hook 0xb560100
  4266. -63> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command config unset hook 0xb560100
  4267. -62> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command config get hook 0xb560100
  4268. -61> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command config diff hook 0xb560100
  4269. -60> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command config diff get hook 0xb560100
  4270. -59> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command log flush hook 0xb560100
  4271. -58> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command log dump hook 0xb560100
  4272. -57> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command log reopen hook 0xb560100
  4273. -56> 2020-08-27 14:41:31.165 7f6e1982cc00 5 asok(0xb626000) register_command dump_mempools hook 0xc21e068
  4274. -55> 2020-08-27 14:41:31.177 7f6e1982cc00 0 set uid:gid to 64045:64045 (ceph:ceph)
  4275. -54> 2020-08-27 14:41:31.177 7f6e1982cc00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3566439
  4276. -53> 2020-08-27 14:41:31.177 7f6e1982cc00 0 pidfile_write: ignore empty --pid-file
  4277. -52> 2020-08-27 14:41:31.177 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4278. -51> 2020-08-27 14:41:31.177 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4279. -50> 2020-08-27 14:41:31.177 7f6e1982cc00 0 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4280. -49> 2020-08-27 14:41:31.177 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4281. -48> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4282. -47> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4283. -46> 2020-08-27 14:41:31.181 7f6e1982cc00 0 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4284. -45> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4285. -44> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4286. -43> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4287. -42> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4288. -41> 2020-08-27 14:41:31.181 7f6e1982cc00 0 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4289. -40> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4290. -39> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4291. -38> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4292. -37> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4293. -36> 2020-08-27 14:41:31.181 7f6e1982cc00 0 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4294. -35> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4295. -34> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4296. -33> 2020-08-27 14:41:31.181 7f6e1982cc00 1 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  4297. -32> 2020-08-27 14:41:31.525 7f6e1982cc00 1 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block.db) close
  4298. -31> 2020-08-27 14:41:31.781 7f6e1982cc00 1 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block) close
  4299. -30> 2020-08-27 14:41:32.017 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) close
  4300. -29> 2020-08-27 14:41:32.257 7f6e1982cc00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  4301. -28> 2020-08-27 14:41:32.265 7f6e1982cc00 0 load: jerasure load: lrc load: isa
  4302. -27> 2020-08-27 14:41:32.265 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4303. -26> 2020-08-27 14:41:32.265 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4304. -25> 2020-08-27 14:41:32.265 7f6e1982cc00 0 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4305. -24> 2020-08-27 14:41:32.265 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4306. -23> 2020-08-27 14:41:32.265 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) close
  4307. -22> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4308. -21> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4309. -20> 2020-08-27 14:41:32.601 7f6e1982cc00 0 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4310. -19> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4311. -18> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4312. -17> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4313. -16> 2020-08-27 14:41:32.601 7f6e1982cc00 0 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4314. -15> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31ce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4315. -14> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4316. -13> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4317. -12> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4318. -11> 2020-08-27 14:41:32.601 7f6e1982cc00 0 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4319. -10> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31c700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4320. -9> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4321. -8> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4322. -7> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4323. -6> 2020-08-27 14:41:32.601 7f6e1982cc00 0 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4324. -5> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bdev(0xc31ca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4325. -4> 2020-08-27 14:41:32.601 7f6e1982cc00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4326. -3> 2020-08-27 14:41:32.601 7f6e1982cc00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  4327. -2> 2020-08-27 14:41:32.601 7f6e1982cc00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  4328. -1> 2020-08-27 14:41:32.605 7f6e1982cc00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f6e1982cc00 time 2020-08-27 14:41:32.608408
  4329. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  4330.  
  4331. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4332. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  4333. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4334. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4335. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4336. 5: (OSD::init()+0x3f3) [0x8f5483]
  4337. 6: (main()+0x27e2) [0x84c462]
  4338. 7: (__libc_start_main()+0xf0) [0x7f6e169dd830]
  4339. 8: (_start()+0x29) [0x880389]
  4340.  
  4341. 0> 2020-08-27 14:41:32.609 7f6e1982cc00 -1 *** Caught signal (Aborted) **
  4342. in thread 7f6e1982cc00 thread_name:ceph-osd
  4343.  
  4344. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4345. 1: (()+0x11390) [0x7f6e174c7390]
  4346. 2: (gsignal()+0x38) [0x7f6e169f2428]
  4347. 3: (abort()+0x16a) [0x7f6e169f402a]
  4348. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  4349. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4350. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4351. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4352. 8: (OSD::init()+0x3f3) [0x8f5483]
  4353. 9: (main()+0x27e2) [0x84c462]
  4354. 10: (__libc_start_main()+0xf0) [0x7f6e169dd830]
  4355. 11: (_start()+0x29) [0x880389]
  4356. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  4357.  
  4358. --- logging levels ---
  4359. 0/ 5 none
  4360. 0/ 0 lockdep
  4361. 0/ 0 context
  4362. 0/ 0 crush
  4363. 1/ 5 mds
  4364. 1/ 5 mds_balancer
  4365. 1/ 5 mds_locker
  4366. 1/ 5 mds_log
  4367. 1/ 5 mds_log_expire
  4368. 1/ 5 mds_migrator
  4369. 0/ 0 buffer
  4370. 0/ 0 timer
  4371. 0/ 0 filer
  4372. 0/ 1 striper
  4373. 0/ 0 objecter
  4374. 0/ 0 rados
  4375. 0/ 0 rbd
  4376. 0/ 5 rbd_mirror
  4377. 0/ 5 rbd_replay
  4378. 0/ 0 journaler
  4379. 0/ 0 objectcacher
  4380. 0/ 0 client
  4381. 0/ 0 osd
  4382. 0/ 0 optracker
  4383. 0/ 0 objclass
  4384. 0/ 0 filestore
  4385. 0/ 0 journal
  4386. 0/ 0 ms
  4387. 0/ 0 mon
  4388. 0/ 0 monc
  4389. 0/ 0 paxos
  4390. 0/ 0 tp
  4391. 0/ 0 auth
  4392. 1/ 5 crypto
  4393. 0/ 0 finisher
  4394. 1/ 1 reserver
  4395. 0/ 0 heartbeatmap
  4396. 0/ 0 perfcounter
  4397. 0/ 0 rgw
  4398. 1/ 5 rgw_sync
  4399. 1/10 civetweb
  4400. 1/ 5 javaclient
  4401. 0/ 0 asok
  4402. 0/ 0 throttle
  4403. 0/ 0 refs
  4404. 1/ 5 xio
  4405. 1/ 5 compressor
  4406. 0/ 0 bluestore
  4407. 1/ 5 bluefs
  4408. 1/ 3 bdev
  4409. 1/ 5 kstore
  4410. 4/ 5 rocksdb
  4411. 4/ 5 leveldb
  4412. 4/ 5 memdb
  4413. 1/ 5 kinetic
  4414. 1/ 5 fuse
  4415. 1/ 5 mgr
  4416. 1/ 5 mgrc
  4417. 1/ 5 dpdk
  4418. 1/ 5 eventtrace
  4419. 1/ 5 prioritycache
  4420. -2/-2 (syslog threshold)
  4421. -1/-1 (stderr threshold)
  4422. max_recent 10000
  4423. max_new 1000
  4424. log_file /var/log/ceph/ceph-osd.108.log
  4425. --- end dump of recent events ---
  4426. 2020-08-27 14:41:33.385 7fa380b66c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  4427. 2020-08-27 14:41:33.385 7fa380b66c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3567637
  4428. 2020-08-27 14:41:33.385 7fa380b66c00 0 pidfile_write: ignore empty --pid-file
  4429. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4430. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4431. 2020-08-27 14:41:33.389 7fa380b66c00 0 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4432. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4433. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4434. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4435. 2020-08-27 14:41:33.389 7fa380b66c00 0 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4436. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4437. 2020-08-27 14:41:33.389 7fa380b66c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4438. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4439. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4440. 2020-08-27 14:41:33.389 7fa380b66c00 0 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4441. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4442. 2020-08-27 14:41:33.389 7fa380b66c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4443. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4444. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4445. 2020-08-27 14:41:33.389 7fa380b66c00 0 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4446. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4447. 2020-08-27 14:41:33.389 7fa380b66c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4448. 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  4449. 2020-08-27 14:41:33.785 7fa380b66c00 1 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block.db) close
  4450. 2020-08-27 14:41:33.973 7fa380b66c00 1 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block) close
  4451. 2020-08-27 14:41:34.281 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) close
  4452. 2020-08-27 14:41:34.477 7fa380b66c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  4453. 2020-08-27 14:41:34.485 7fa380b66c00 0 load: jerasure load: lrc load: isa
  4454. 2020-08-27 14:41:34.485 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4455. 2020-08-27 14:41:34.485 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4456. 2020-08-27 14:41:34.485 7fa380b66c00 0 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4457. 2020-08-27 14:41:34.485 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4458. 2020-08-27 14:41:34.485 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) close
  4459. 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4460. 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4461. 2020-08-27 14:41:34.789 7fa380b66c00 0 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4462. 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4463. 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4464. 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4465. 2020-08-27 14:41:34.789 7fa380b66c00 0 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4466. 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4467. 2020-08-27 14:41:34.789 7fa380b66c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4468. 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4469. 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4470. 2020-08-27 14:41:34.789 7fa380b66c00 0 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4471. 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4472. 2020-08-27 14:41:34.789 7fa380b66c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4473. 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4474. 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4475. 2020-08-27 14:41:34.789 7fa380b66c00 0 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4476. 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4477. 2020-08-27 14:41:34.789 7fa380b66c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4478. 2020-08-27 14:41:34.789 7fa380b66c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  4479. 2020-08-27 14:41:34.789 7fa380b66c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  4480. 2020-08-27 14:41:34.793 7fa380b66c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7fa380b66c00 time 2020-08-27 14:41:34.795850
  4481. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  4482.  
  4483. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4484. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  4485. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4486. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4487. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4488. 5: (OSD::init()+0x3f3) [0x8f5483]
  4489. 6: (main()+0x27e2) [0x84c462]
  4490. 7: (__libc_start_main()+0xf0) [0x7fa37dd17830]
  4491. 8: (_start()+0x29) [0x880389]
  4492.  
  4493. 2020-08-27 14:41:34.797 7fa380b66c00 -1 *** Caught signal (Aborted) **
  4494. in thread 7fa380b66c00 thread_name:ceph-osd
  4495.  
  4496. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4497. 1: (()+0x11390) [0x7fa37e801390]
  4498. 2: (gsignal()+0x38) [0x7fa37dd2c428]
  4499. 3: (abort()+0x16a) [0x7fa37dd2e02a]
  4500. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  4501. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4502. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4503. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4504. 8: (OSD::init()+0x3f3) [0x8f5483]
  4505. 9: (main()+0x27e2) [0x84c462]
  4506. 10: (__libc_start_main()+0xf0) [0x7fa37dd17830]
  4507. 11: (_start()+0x29) [0x880389]
  4508. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  4509.  
  4510. --- begin dump of recent events ---
  4511. -77> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command assert hook 0xb436100
  4512. -76> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command abort hook 0xb436100
  4513. -75> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command perfcounters_dump hook 0xb436100
  4514. -74> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command 1 hook 0xb436100
  4515. -73> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command perf dump hook 0xb436100
  4516. -72> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command perfcounters_schema hook 0xb436100
  4517. -71> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command perf histogram dump hook 0xb436100
  4518. -70> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command 2 hook 0xb436100
  4519. -69> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command perf schema hook 0xb436100
  4520. -68> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command perf histogram schema hook 0xb436100
  4521. -67> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command perf reset hook 0xb436100
  4522. -66> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command config show hook 0xb436100
  4523. -65> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command config help hook 0xb436100
  4524. -64> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command config set hook 0xb436100
  4525. -63> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command config unset hook 0xb436100
  4526. -62> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command config get hook 0xb436100
  4527. -61> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command config diff hook 0xb436100
  4528. -60> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command config diff get hook 0xb436100
  4529. -59> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command log flush hook 0xb436100
  4530. -58> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command log dump hook 0xb436100
  4531. -57> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command log reopen hook 0xb436100
  4532. -56> 2020-08-27 14:41:33.377 7fa380b66c00 5 asok(0xb4fc000) register_command dump_mempools hook 0xc0f4068
  4533. -55> 2020-08-27 14:41:33.385 7fa380b66c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  4534. -54> 2020-08-27 14:41:33.385 7fa380b66c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3567637
  4535. -53> 2020-08-27 14:41:33.385 7fa380b66c00 0 pidfile_write: ignore empty --pid-file
  4536. -52> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4537. -51> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4538. -50> 2020-08-27 14:41:33.389 7fa380b66c00 0 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4539. -49> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4540. -48> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4541. -47> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4542. -46> 2020-08-27 14:41:33.389 7fa380b66c00 0 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4543. -45> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4544. -44> 2020-08-27 14:41:33.389 7fa380b66c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4545. -43> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4546. -42> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4547. -41> 2020-08-27 14:41:33.389 7fa380b66c00 0 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4548. -40> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4549. -39> 2020-08-27 14:41:33.389 7fa380b66c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4550. -38> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4551. -37> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4552. -36> 2020-08-27 14:41:33.389 7fa380b66c00 0 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4553. -35> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4554. -34> 2020-08-27 14:41:33.389 7fa380b66c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4555. -33> 2020-08-27 14:41:33.389 7fa380b66c00 1 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  4556. -32> 2020-08-27 14:41:33.785 7fa380b66c00 1 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block.db) close
  4557. -31> 2020-08-27 14:41:33.973 7fa380b66c00 1 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block) close
  4558. -30> 2020-08-27 14:41:34.281 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) close
  4559. -29> 2020-08-27 14:41:34.477 7fa380b66c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  4560. -28> 2020-08-27 14:41:34.485 7fa380b66c00 0 load: jerasure load: lrc load: isa
  4561. -27> 2020-08-27 14:41:34.485 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4562. -26> 2020-08-27 14:41:34.485 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4563. -25> 2020-08-27 14:41:34.485 7fa380b66c00 0 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4564. -24> 2020-08-27 14:41:34.485 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4565. -23> 2020-08-27 14:41:34.485 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) close
  4566. -22> 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4567. -21> 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4568. -20> 2020-08-27 14:41:34.789 7fa380b66c00 0 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4569. -19> 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4570. -18> 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4571. -17> 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4572. -16> 2020-08-27 14:41:34.789 7fa380b66c00 0 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4573. -15> 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4574. -14> 2020-08-27 14:41:34.789 7fa380b66c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4575. -13> 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4576. -12> 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4577. -11> 2020-08-27 14:41:34.789 7fa380b66c00 0 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4578. -10> 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4579. -9> 2020-08-27 14:41:34.789 7fa380b66c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4580. -8> 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4581. -7> 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4582. -6> 2020-08-27 14:41:34.789 7fa380b66c00 0 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4583. -5> 2020-08-27 14:41:34.789 7fa380b66c00 1 bdev(0xc1e6a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4584. -4> 2020-08-27 14:41:34.789 7fa380b66c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4585. -3> 2020-08-27 14:41:34.789 7fa380b66c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  4586. -2> 2020-08-27 14:41:34.789 7fa380b66c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  4587. -1> 2020-08-27 14:41:34.793 7fa380b66c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7fa380b66c00 time 2020-08-27 14:41:34.795850
  4588. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  4589.  
  4590. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4591. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  4592. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4593. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4594. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4595. 5: (OSD::init()+0x3f3) [0x8f5483]
  4596. 6: (main()+0x27e2) [0x84c462]
  4597. 7: (__libc_start_main()+0xf0) [0x7fa37dd17830]
  4598. 8: (_start()+0x29) [0x880389]
  4599.  
  4600. 0> 2020-08-27 14:41:34.797 7fa380b66c00 -1 *** Caught signal (Aborted) **
  4601. in thread 7fa380b66c00 thread_name:ceph-osd
  4602.  
  4603. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4604. 1: (()+0x11390) [0x7fa37e801390]
  4605. 2: (gsignal()+0x38) [0x7fa37dd2c428]
  4606. 3: (abort()+0x16a) [0x7fa37dd2e02a]
  4607. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  4608. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4609. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4610. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4611. 8: (OSD::init()+0x3f3) [0x8f5483]
  4612. 9: (main()+0x27e2) [0x84c462]
  4613. 10: (__libc_start_main()+0xf0) [0x7fa37dd17830]
  4614. 11: (_start()+0x29) [0x880389]
  4615. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  4616.  
  4617. --- logging levels ---
  4618. 0/ 5 none
  4619. 0/ 0 lockdep
  4620. 0/ 0 context
  4621. 0/ 0 crush
  4622. 1/ 5 mds
  4623. 1/ 5 mds_balancer
  4624. 1/ 5 mds_locker
  4625. 1/ 5 mds_log
  4626. 1/ 5 mds_log_expire
  4627. 1/ 5 mds_migrator
  4628. 0/ 0 buffer
  4629. 0/ 0 timer
  4630. 0/ 0 filer
  4631. 0/ 1 striper
  4632. 0/ 0 objecter
  4633. 0/ 0 rados
  4634. 0/ 0 rbd
  4635. 0/ 5 rbd_mirror
  4636. 0/ 5 rbd_replay
  4637. 0/ 0 journaler
  4638. 0/ 0 objectcacher
  4639. 0/ 0 client
  4640. 0/ 0 osd
  4641. 0/ 0 optracker
  4642. 0/ 0 objclass
  4643. 0/ 0 filestore
  4644. 0/ 0 journal
  4645. 0/ 0 ms
  4646. 0/ 0 mon
  4647. 0/ 0 monc
  4648. 0/ 0 paxos
  4649. 0/ 0 tp
  4650. 0/ 0 auth
  4651. 1/ 5 crypto
  4652. 0/ 0 finisher
  4653. 1/ 1 reserver
  4654. 0/ 0 heartbeatmap
  4655. 0/ 0 perfcounter
  4656. 0/ 0 rgw
  4657. 1/ 5 rgw_sync
  4658. 1/10 civetweb
  4659. 1/ 5 javaclient
  4660. 0/ 0 asok
  4661. 0/ 0 throttle
  4662. 0/ 0 refs
  4663. 1/ 5 xio
  4664. 1/ 5 compressor
  4665. 0/ 0 bluestore
  4666. 1/ 5 bluefs
  4667. 1/ 3 bdev
  4668. 1/ 5 kstore
  4669. 4/ 5 rocksdb
  4670. 4/ 5 leveldb
  4671. 4/ 5 memdb
  4672. 1/ 5 kinetic
  4673. 1/ 5 fuse
  4674. 1/ 5 mgr
  4675. 1/ 5 mgrc
  4676. 1/ 5 dpdk
  4677. 1/ 5 eventtrace
  4678. 1/ 5 prioritycache
  4679. -2/-2 (syslog threshold)
  4680. -1/-1 (stderr threshold)
  4681. max_recent 10000
  4682. max_new 1000
  4683. log_file /var/log/ceph/ceph-osd.108.log
  4684. --- end dump of recent events ---
  4685. 2020-08-27 14:41:35.573 7ff670e14c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  4686. 2020-08-27 14:41:35.573 7ff670e14c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3568878
  4687. 2020-08-27 14:41:35.573 7ff670e14c00 0 pidfile_write: ignore empty --pid-file
  4688. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4689. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4690. 2020-08-27 14:41:35.577 7ff670e14c00 0 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4691. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4692. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4693. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4694. 2020-08-27 14:41:35.577 7ff670e14c00 0 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4695. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4696. 2020-08-27 14:41:35.577 7ff670e14c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4697. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4698. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4699. 2020-08-27 14:41:35.577 7ff670e14c00 0 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4700. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4701. 2020-08-27 14:41:35.577 7ff670e14c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4702. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4703. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4704. 2020-08-27 14:41:35.577 7ff670e14c00 0 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4705. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4706. 2020-08-27 14:41:35.577 7ff670e14c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4707. 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  4708. 2020-08-27 14:41:35.937 7ff670e14c00 1 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block.db) close
  4709. 2020-08-27 14:41:36.149 7ff670e14c00 1 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block) close
  4710. 2020-08-27 14:41:36.381 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) close
  4711. 2020-08-27 14:41:36.669 7ff670e14c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  4712. 2020-08-27 14:41:36.677 7ff670e14c00 0 load: jerasure load: lrc load: isa
  4713. 2020-08-27 14:41:36.677 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4714. 2020-08-27 14:41:36.677 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4715. 2020-08-27 14:41:36.677 7ff670e14c00 0 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4716. 2020-08-27 14:41:36.677 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4717. 2020-08-27 14:41:36.677 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) close
  4718. 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4719. 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4720. 2020-08-27 14:41:36.985 7ff670e14c00 0 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4721. 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4722. 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4723. 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4724. 2020-08-27 14:41:36.985 7ff670e14c00 0 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4725. 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4726. 2020-08-27 14:41:36.985 7ff670e14c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4727. 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4728. 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4729. 2020-08-27 14:41:36.985 7ff670e14c00 0 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4730. 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4731. 2020-08-27 14:41:36.985 7ff670e14c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4732. 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4733. 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4734. 2020-08-27 14:41:36.985 7ff670e14c00 0 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4735. 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4736. 2020-08-27 14:41:36.985 7ff670e14c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4737. 2020-08-27 14:41:36.985 7ff670e14c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  4738. 2020-08-27 14:41:36.985 7ff670e14c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  4739. 2020-08-27 14:41:36.989 7ff670e14c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7ff670e14c00 time 2020-08-27 14:41:36.991833
  4740. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  4741.  
  4742. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4743. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  4744. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4745. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4746. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4747. 5: (OSD::init()+0x3f3) [0x8f5483]
  4748. 6: (main()+0x27e2) [0x84c462]
  4749. 7: (__libc_start_main()+0xf0) [0x7ff66dfc5830]
  4750. 8: (_start()+0x29) [0x880389]
  4751.  
  4752. 2020-08-27 14:41:36.993 7ff670e14c00 -1 *** Caught signal (Aborted) **
  4753. in thread 7ff670e14c00 thread_name:ceph-osd
  4754.  
  4755. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4756. 1: (()+0x11390) [0x7ff66eaaf390]
  4757. 2: (gsignal()+0x38) [0x7ff66dfda428]
  4758. 3: (abort()+0x16a) [0x7ff66dfdc02a]
  4759. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  4760. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4761. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4762. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4763. 8: (OSD::init()+0x3f3) [0x8f5483]
  4764. 9: (main()+0x27e2) [0x84c462]
  4765. 10: (__libc_start_main()+0xf0) [0x7ff66dfc5830]
  4766. 11: (_start()+0x29) [0x880389]
  4767. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  4768.  
  4769. --- begin dump of recent events ---
  4770. -77> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command assert hook 0xc120100
  4771. -76> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command abort hook 0xc120100
  4772. -75> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command perfcounters_dump hook 0xc120100
  4773. -74> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command 1 hook 0xc120100
  4774. -73> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command perf dump hook 0xc120100
  4775. -72> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command perfcounters_schema hook 0xc120100
  4776. -71> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command perf histogram dump hook 0xc120100
  4777. -70> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command 2 hook 0xc120100
  4778. -69> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command perf schema hook 0xc120100
  4779. -68> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command perf histogram schema hook 0xc120100
  4780. -67> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command perf reset hook 0xc120100
  4781. -66> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command config show hook 0xc120100
  4782. -65> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command config help hook 0xc120100
  4783. -64> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command config set hook 0xc120100
  4784. -63> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command config unset hook 0xc120100
  4785. -62> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command config get hook 0xc120100
  4786. -61> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command config diff hook 0xc120100
  4787. -60> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command config diff get hook 0xc120100
  4788. -59> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command log flush hook 0xc120100
  4789. -58> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command log dump hook 0xc120100
  4790. -57> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command log reopen hook 0xc120100
  4791. -56> 2020-08-27 14:41:35.565 7ff670e14c00 5 asok(0xc1e6000) register_command dump_mempools hook 0xcdde068
  4792. -55> 2020-08-27 14:41:35.573 7ff670e14c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  4793. -54> 2020-08-27 14:41:35.573 7ff670e14c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3568878
  4794. -53> 2020-08-27 14:41:35.573 7ff670e14c00 0 pidfile_write: ignore empty --pid-file
  4795. -52> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4796. -51> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4797. -50> 2020-08-27 14:41:35.577 7ff670e14c00 0 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4798. -49> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4799. -48> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4800. -47> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4801. -46> 2020-08-27 14:41:35.577 7ff670e14c00 0 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4802. -45> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4803. -44> 2020-08-27 14:41:35.577 7ff670e14c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4804. -43> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4805. -42> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4806. -41> 2020-08-27 14:41:35.577 7ff670e14c00 0 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4807. -40> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4808. -39> 2020-08-27 14:41:35.577 7ff670e14c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4809. -38> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4810. -37> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4811. -36> 2020-08-27 14:41:35.577 7ff670e14c00 0 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4812. -35> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4813. -34> 2020-08-27 14:41:35.577 7ff670e14c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4814. -33> 2020-08-27 14:41:35.577 7ff670e14c00 1 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  4815. -32> 2020-08-27 14:41:35.937 7ff670e14c00 1 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block.db) close
  4816. -31> 2020-08-27 14:41:36.149 7ff670e14c00 1 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block) close
  4817. -30> 2020-08-27 14:41:36.381 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) close
  4818. -29> 2020-08-27 14:41:36.669 7ff670e14c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  4819. -28> 2020-08-27 14:41:36.677 7ff670e14c00 0 load: jerasure load: lrc load: isa
  4820. -27> 2020-08-27 14:41:36.677 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4821. -26> 2020-08-27 14:41:36.677 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4822. -25> 2020-08-27 14:41:36.677 7ff670e14c00 0 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4823. -24> 2020-08-27 14:41:36.677 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4824. -23> 2020-08-27 14:41:36.677 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) close
  4825. -22> 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4826. -21> 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4827. -20> 2020-08-27 14:41:36.985 7ff670e14c00 0 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4828. -19> 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4829. -18> 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4830. -17> 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4831. -16> 2020-08-27 14:41:36.985 7ff670e14c00 0 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4832. -15> 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0ce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4833. -14> 2020-08-27 14:41:36.985 7ff670e14c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4834. -13> 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4835. -12> 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4836. -11> 2020-08-27 14:41:36.985 7ff670e14c00 0 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4837. -10> 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0c700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4838. -9> 2020-08-27 14:41:36.985 7ff670e14c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4839. -8> 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4840. -7> 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4841. -6> 2020-08-27 14:41:36.985 7ff670e14c00 0 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4842. -5> 2020-08-27 14:41:36.985 7ff670e14c00 1 bdev(0xce0ca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4843. -4> 2020-08-27 14:41:36.985 7ff670e14c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4844. -3> 2020-08-27 14:41:36.985 7ff670e14c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  4845. -2> 2020-08-27 14:41:36.985 7ff670e14c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  4846. -1> 2020-08-27 14:41:36.989 7ff670e14c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7ff670e14c00 time 2020-08-27 14:41:36.991833
  4847. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  4848.  
  4849. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4850. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  4851. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4852. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4853. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4854. 5: (OSD::init()+0x3f3) [0x8f5483]
  4855. 6: (main()+0x27e2) [0x84c462]
  4856. 7: (__libc_start_main()+0xf0) [0x7ff66dfc5830]
  4857. 8: (_start()+0x29) [0x880389]
  4858.  
  4859. 0> 2020-08-27 14:41:36.993 7ff670e14c00 -1 *** Caught signal (Aborted) **
  4860. in thread 7ff670e14c00 thread_name:ceph-osd
  4861.  
  4862. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  4863. 1: (()+0x11390) [0x7ff66eaaf390]
  4864. 2: (gsignal()+0x38) [0x7ff66dfda428]
  4865. 3: (abort()+0x16a) [0x7ff66dfdc02a]
  4866. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  4867. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  4868. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  4869. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  4870. 8: (OSD::init()+0x3f3) [0x8f5483]
  4871. 9: (main()+0x27e2) [0x84c462]
  4872. 10: (__libc_start_main()+0xf0) [0x7ff66dfc5830]
  4873. 11: (_start()+0x29) [0x880389]
  4874. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  4875.  
  4876. --- logging levels ---
  4877. 0/ 5 none
  4878. 0/ 0 lockdep
  4879. 0/ 0 context
  4880. 0/ 0 crush
  4881. 1/ 5 mds
  4882. 1/ 5 mds_balancer
  4883. 1/ 5 mds_locker
  4884. 1/ 5 mds_log
  4885. 1/ 5 mds_log_expire
  4886. 1/ 5 mds_migrator
  4887. 0/ 0 buffer
  4888. 0/ 0 timer
  4889. 0/ 0 filer
  4890. 0/ 1 striper
  4891. 0/ 0 objecter
  4892. 0/ 0 rados
  4893. 0/ 0 rbd
  4894. 0/ 5 rbd_mirror
  4895. 0/ 5 rbd_replay
  4896. 0/ 0 journaler
  4897. 0/ 0 objectcacher
  4898. 0/ 0 client
  4899. 0/ 0 osd
  4900. 0/ 0 optracker
  4901. 0/ 0 objclass
  4902. 0/ 0 filestore
  4903. 0/ 0 journal
  4904. 0/ 0 ms
  4905. 0/ 0 mon
  4906. 0/ 0 monc
  4907. 0/ 0 paxos
  4908. 0/ 0 tp
  4909. 0/ 0 auth
  4910. 1/ 5 crypto
  4911. 0/ 0 finisher
  4912. 1/ 1 reserver
  4913. 0/ 0 heartbeatmap
  4914. 0/ 0 perfcounter
  4915. 0/ 0 rgw
  4916. 1/ 5 rgw_sync
  4917. 1/10 civetweb
  4918. 1/ 5 javaclient
  4919. 0/ 0 asok
  4920. 0/ 0 throttle
  4921. 0/ 0 refs
  4922. 1/ 5 xio
  4923. 1/ 5 compressor
  4924. 0/ 0 bluestore
  4925. 1/ 5 bluefs
  4926. 1/ 3 bdev
  4927. 1/ 5 kstore
  4928. 4/ 5 rocksdb
  4929. 4/ 5 leveldb
  4930. 4/ 5 memdb
  4931. 1/ 5 kinetic
  4932. 1/ 5 fuse
  4933. 1/ 5 mgr
  4934. 1/ 5 mgrc
  4935. 1/ 5 dpdk
  4936. 1/ 5 eventtrace
  4937. 1/ 5 prioritycache
  4938. -2/-2 (syslog threshold)
  4939. -1/-1 (stderr threshold)
  4940. max_recent 10000
  4941. max_new 1000
  4942. log_file /var/log/ceph/ceph-osd.108.log
  4943. --- end dump of recent events ---
  4944. 2020-08-27 14:41:37.725 7ff56b8fac00 0 set uid:gid to 64045:64045 (ceph:ceph)
  4945. 2020-08-27 14:41:37.725 7ff56b8fac00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3570266
  4946. 2020-08-27 14:41:37.725 7ff56b8fac00 0 pidfile_write: ignore empty --pid-file
  4947. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4948. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4949. 2020-08-27 14:41:37.725 7ff56b8fac00 0 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4950. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4951. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4952. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4953. 2020-08-27 14:41:37.725 7ff56b8fac00 0 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4954. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4955. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4956. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4957. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4958. 2020-08-27 14:41:37.725 7ff56b8fac00 0 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4959. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4960. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4961. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4962. 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4963. 2020-08-27 14:41:37.725 7ff56b8fac00 0 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4964. 2020-08-27 14:41:37.729 7ff56b8fac00 1 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4965. 2020-08-27 14:41:37.729 7ff56b8fac00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4966. 2020-08-27 14:41:37.729 7ff56b8fac00 1 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  4967. 2020-08-27 14:41:38.037 7ff56b8fac00 1 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block.db) close
  4968. 2020-08-27 14:41:38.317 7ff56b8fac00 1 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block) close
  4969. 2020-08-27 14:41:38.545 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) close
  4970. 2020-08-27 14:41:38.769 7ff56b8fac00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  4971. 2020-08-27 14:41:38.777 7ff56b8fac00 0 load: jerasure load: lrc load: isa
  4972. 2020-08-27 14:41:38.777 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4973. 2020-08-27 14:41:38.777 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4974. 2020-08-27 14:41:38.777 7ff56b8fac00 0 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4975. 2020-08-27 14:41:38.777 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4976. 2020-08-27 14:41:38.777 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) close
  4977. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4978. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4979. 2020-08-27 14:41:39.117 7ff56b8fac00 0 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4980. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4981. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  4982. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  4983. 2020-08-27 14:41:39.117 7ff56b8fac00 0 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  4984. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4985. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  4986. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  4987. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  4988. 2020-08-27 14:41:39.117 7ff56b8fac00 0 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  4989. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4990. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  4991. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  4992. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  4993. 2020-08-27 14:41:39.117 7ff56b8fac00 0 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  4994. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4995. 2020-08-27 14:41:39.117 7ff56b8fac00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  4996. 2020-08-27 14:41:39.117 7ff56b8fac00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  4997. 2020-08-27 14:41:39.117 7ff56b8fac00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  4998. 2020-08-27 14:41:39.121 7ff56b8fac00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7ff56b8fac00 time 2020-08-27 14:41:39.124134
  4999. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  5000.  
  5001. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  5002. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  5003. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  5004. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  5005. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  5006. 5: (OSD::init()+0x3f3) [0x8f5483]
  5007. 6: (main()+0x27e2) [0x84c462]
  5008. 7: (__libc_start_main()+0xf0) [0x7ff568aab830]
  5009. 8: (_start()+0x29) [0x880389]
  5010.  
  5011. 2020-08-27 14:41:39.125 7ff56b8fac00 -1 *** Caught signal (Aborted) **
  5012. in thread 7ff56b8fac00 thread_name:ceph-osd
  5013.  
  5014. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  5015. 1: (()+0x11390) [0x7ff569595390]
  5016. 2: (gsignal()+0x38) [0x7ff568ac0428]
  5017. 3: (abort()+0x16a) [0x7ff568ac202a]
  5018. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  5019. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  5020. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  5021. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  5022. 8: (OSD::init()+0x3f3) [0x8f5483]
  5023. 9: (main()+0x27e2) [0x84c462]
  5024. 10: (__libc_start_main()+0xf0) [0x7ff568aab830]
  5025. 11: (_start()+0x29) [0x880389]
  5026. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  5027.  
  5028. --- begin dump of recent events ---
  5029. -77> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command assert hook 0xba10100
  5030. -76> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command abort hook 0xba10100
  5031. -75> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command perfcounters_dump hook 0xba10100
  5032. -74> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command 1 hook 0xba10100
  5033. -73> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command perf dump hook 0xba10100
  5034. -72> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command perfcounters_schema hook 0xba10100
  5035. -71> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command perf histogram dump hook 0xba10100
  5036. -70> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command 2 hook 0xba10100
  5037. -69> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command perf schema hook 0xba10100
  5038. -68> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command perf histogram schema hook 0xba10100
  5039. -67> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command perf reset hook 0xba10100
  5040. -66> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command config show hook 0xba10100
  5041. -65> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command config help hook 0xba10100
  5042. -64> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command config set hook 0xba10100
  5043. -63> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command config unset hook 0xba10100
  5044. -62> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command config get hook 0xba10100
  5045. -61> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command config diff hook 0xba10100
  5046. -60> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command config diff get hook 0xba10100
  5047. -59> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command log flush hook 0xba10100
  5048. -58> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command log dump hook 0xba10100
  5049. -57> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command log reopen hook 0xba10100
  5050. -56> 2020-08-27 14:41:37.713 7ff56b8fac00 5 asok(0xbad6000) register_command dump_mempools hook 0xc6ce068
  5051. -55> 2020-08-27 14:41:37.725 7ff56b8fac00 0 set uid:gid to 64045:64045 (ceph:ceph)
  5052. -54> 2020-08-27 14:41:37.725 7ff56b8fac00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3570266
  5053. -53> 2020-08-27 14:41:37.725 7ff56b8fac00 0 pidfile_write: ignore empty --pid-file
  5054. -52> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5055. -51> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5056. -50> 2020-08-27 14:41:37.725 7ff56b8fac00 0 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5057. -49> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5058. -48> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  5059. -47> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  5060. -46> 2020-08-27 14:41:37.725 7ff56b8fac00 0 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  5061. -45> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5062. -44> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  5063. -43> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5064. -42> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5065. -41> 2020-08-27 14:41:37.725 7ff56b8fac00 0 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5066. -40> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5067. -39> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  5068. -38> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  5069. -37> 2020-08-27 14:41:37.725 7ff56b8fac00 1 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  5070. -36> 2020-08-27 14:41:37.725 7ff56b8fac00 0 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  5071. -35> 2020-08-27 14:41:37.729 7ff56b8fac00 1 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5072. -34> 2020-08-27 14:41:37.729 7ff56b8fac00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  5073. -33> 2020-08-27 14:41:37.729 7ff56b8fac00 1 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  5074. -32> 2020-08-27 14:41:38.037 7ff56b8fac00 1 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block.db) close
  5075. -31> 2020-08-27 14:41:38.317 7ff56b8fac00 1 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block) close
  5076. -30> 2020-08-27 14:41:38.545 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) close
  5077. -29> 2020-08-27 14:41:38.769 7ff56b8fac00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  5078. -28> 2020-08-27 14:41:38.777 7ff56b8fac00 0 load: jerasure load: lrc load: isa
  5079. -27> 2020-08-27 14:41:38.777 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5080. -26> 2020-08-27 14:41:38.777 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5081. -25> 2020-08-27 14:41:38.777 7ff56b8fac00 0 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5082. -24> 2020-08-27 14:41:38.777 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5083. -23> 2020-08-27 14:41:38.777 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) close
  5084. -22> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5085. -21> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5086. -20> 2020-08-27 14:41:39.117 7ff56b8fac00 0 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5087. -19> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cc000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5088. -18> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  5089. -17> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  5090. -16> 2020-08-27 14:41:39.117 7ff56b8fac00 0 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  5091. -15> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5092. -14> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  5093. -13> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5094. -12> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5095. -11> 2020-08-27 14:41:39.117 7ff56b8fac00 0 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5096. -10> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cc700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5097. -9> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  5098. -8> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  5099. -7> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  5100. -6> 2020-08-27 14:41:39.117 7ff56b8fac00 0 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  5101. -5> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bdev(0xc7cca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5102. -4> 2020-08-27 14:41:39.117 7ff56b8fac00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  5103. -3> 2020-08-27 14:41:39.117 7ff56b8fac00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  5104. -2> 2020-08-27 14:41:39.117 7ff56b8fac00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  5105. -1> 2020-08-27 14:41:39.121 7ff56b8fac00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7ff56b8fac00 time 2020-08-27 14:41:39.124134
  5106. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  5107.  
  5108. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  5109. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  5110. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  5111. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  5112. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  5113. 5: (OSD::init()+0x3f3) [0x8f5483]
  5114. 6: (main()+0x27e2) [0x84c462]
  5115. 7: (__libc_start_main()+0xf0) [0x7ff568aab830]
  5116. 8: (_start()+0x29) [0x880389]
  5117.  
  5118. 0> 2020-08-27 14:41:39.125 7ff56b8fac00 -1 *** Caught signal (Aborted) **
  5119. in thread 7ff56b8fac00 thread_name:ceph-osd
  5120.  
  5121. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  5122. 1: (()+0x11390) [0x7ff569595390]
  5123. 2: (gsignal()+0x38) [0x7ff568ac0428]
  5124. 3: (abort()+0x16a) [0x7ff568ac202a]
  5125. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  5126. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  5127. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  5128. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  5129. 8: (OSD::init()+0x3f3) [0x8f5483]
  5130. 9: (main()+0x27e2) [0x84c462]
  5131. 10: (__libc_start_main()+0xf0) [0x7ff568aab830]
  5132. 11: (_start()+0x29) [0x880389]
  5133. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  5134.  
  5135. --- logging levels ---
  5136. 0/ 5 none
  5137. 0/ 0 lockdep
  5138. 0/ 0 context
  5139. 0/ 0 crush
  5140. 1/ 5 mds
  5141. 1/ 5 mds_balancer
  5142. 1/ 5 mds_locker
  5143. 1/ 5 mds_log
  5144. 1/ 5 mds_log_expire
  5145. 1/ 5 mds_migrator
  5146. 0/ 0 buffer
  5147. 0/ 0 timer
  5148. 0/ 0 filer
  5149. 0/ 1 striper
  5150. 0/ 0 objecter
  5151. 0/ 0 rados
  5152. 0/ 0 rbd
  5153. 0/ 5 rbd_mirror
  5154. 0/ 5 rbd_replay
  5155. 0/ 0 journaler
  5156. 0/ 0 objectcacher
  5157. 0/ 0 client
  5158. 0/ 0 osd
  5159. 0/ 0 optracker
  5160. 0/ 0 objclass
  5161. 0/ 0 filestore
  5162. 0/ 0 journal
  5163. 0/ 0 ms
  5164. 0/ 0 mon
  5165. 0/ 0 monc
  5166. 0/ 0 paxos
  5167. 0/ 0 tp
  5168. 0/ 0 auth
  5169. 1/ 5 crypto
  5170. 0/ 0 finisher
  5171. 1/ 1 reserver
  5172. 0/ 0 heartbeatmap
  5173. 0/ 0 perfcounter
  5174. 0/ 0 rgw
  5175. 1/ 5 rgw_sync
  5176. 1/10 civetweb
  5177. 1/ 5 javaclient
  5178. 0/ 0 asok
  5179. 0/ 0 throttle
  5180. 0/ 0 refs
  5181. 1/ 5 xio
  5182. 1/ 5 compressor
  5183. 0/ 0 bluestore
  5184. 1/ 5 bluefs
  5185. 1/ 3 bdev
  5186. 1/ 5 kstore
  5187. 4/ 5 rocksdb
  5188. 4/ 5 leveldb
  5189. 4/ 5 memdb
  5190. 1/ 5 kinetic
  5191. 1/ 5 fuse
  5192. 1/ 5 mgr
  5193. 1/ 5 mgrc
  5194. 1/ 5 dpdk
  5195. 1/ 5 eventtrace
  5196. 1/ 5 prioritycache
  5197. -2/-2 (syslog threshold)
  5198. -1/-1 (stderr threshold)
  5199. max_recent 10000
  5200. max_new 1000
  5201. log_file /var/log/ceph/ceph-osd.108.log
  5202. --- end dump of recent events ---
  5203. 2020-08-27 14:41:39.717 7f3130c89c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  5204. 2020-08-27 14:41:39.717 7f3130c89c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3571533
  5205. 2020-08-27 14:41:39.717 7f3130c89c00 0 pidfile_write: ignore empty --pid-file
  5206. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5207. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5208. 2020-08-27 14:41:39.721 7f3130c89c00 0 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5209. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5210. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  5211. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  5212. 2020-08-27 14:41:39.721 7f3130c89c00 0 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  5213. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5214. 2020-08-27 14:41:39.721 7f3130c89c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  5215. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5216. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5217. 2020-08-27 14:41:39.721 7f3130c89c00 0 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5218. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5219. 2020-08-27 14:41:39.721 7f3130c89c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  5220. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  5221. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  5222. 2020-08-27 14:41:39.721 7f3130c89c00 0 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  5223. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5224. 2020-08-27 14:41:39.721 7f3130c89c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  5225. 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  5226. 2020-08-27 14:41:40.045 7f3130c89c00 1 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block.db) close
  5227. 2020-08-27 14:41:40.309 7f3130c89c00 1 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block) close
  5228. 2020-08-27 14:41:40.525 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) close
  5229. 2020-08-27 14:41:40.781 7f3130c89c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  5230. 2020-08-27 14:41:40.793 7f3130c89c00 0 load: jerasure load: lrc load: isa
  5231. 2020-08-27 14:41:40.793 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5232. 2020-08-27 14:41:40.793 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5233. 2020-08-27 14:41:40.813 7f3130c89c00 0 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5234. 2020-08-27 14:41:40.817 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5235. 2020-08-27 14:41:40.817 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) close
  5236. 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5237. 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5238. 2020-08-27 14:41:41.161 7f3130c89c00 0 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5239. 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5240. 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  5241. 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  5242. 2020-08-27 14:41:41.161 7f3130c89c00 0 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  5243. 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5244. 2020-08-27 14:41:41.161 7f3130c89c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  5245. 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5246. 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5247. 2020-08-27 14:41:41.161 7f3130c89c00 0 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5248. 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5249. 2020-08-27 14:41:41.161 7f3130c89c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  5250. 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  5251. 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  5252. 2020-08-27 14:41:41.161 7f3130c89c00 0 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  5253. 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5254. 2020-08-27 14:41:41.161 7f3130c89c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  5255. 2020-08-27 14:41:41.161 7f3130c89c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  5256. 2020-08-27 14:41:41.161 7f3130c89c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  5257. 2020-08-27 14:41:41.165 7f3130c89c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f3130c89c00 time 2020-08-27 14:41:41.167941
  5258. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  5259.  
  5260. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  5261. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  5262. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  5263. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  5264. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  5265. 5: (OSD::init()+0x3f3) [0x8f5483]
  5266. 6: (main()+0x27e2) [0x84c462]
  5267. 7: (__libc_start_main()+0xf0) [0x7f312de3a830]
  5268. 8: (_start()+0x29) [0x880389]
  5269.  
  5270. 2020-08-27 14:41:41.169 7f3130c89c00 -1 *** Caught signal (Aborted) **
  5271. in thread 7f3130c89c00 thread_name:ceph-osd
  5272.  
  5273. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  5274. 1: (()+0x11390) [0x7f312e924390]
  5275. 2: (gsignal()+0x38) [0x7f312de4f428]
  5276. 3: (abort()+0x16a) [0x7f312de5102a]
  5277. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  5278. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  5279. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  5280. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  5281. 8: (OSD::init()+0x3f3) [0x8f5483]
  5282. 9: (main()+0x27e2) [0x84c462]
  5283. 10: (__libc_start_main()+0xf0) [0x7f312de3a830]
  5284. 11: (_start()+0x29) [0x880389]
  5285. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  5286.  
  5287. --- begin dump of recent events ---
  5288. -77> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command assert hook 0xbc64100
  5289. -76> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command abort hook 0xbc64100
  5290. -75> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command perfcounters_dump hook 0xbc64100
  5291. -74> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command 1 hook 0xbc64100
  5292. -73> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command perf dump hook 0xbc64100
  5293. -72> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command perfcounters_schema hook 0xbc64100
  5294. -71> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command perf histogram dump hook 0xbc64100
  5295. -70> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command 2 hook 0xbc64100
  5296. -69> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command perf schema hook 0xbc64100
  5297. -68> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command perf histogram schema hook 0xbc64100
  5298. -67> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command perf reset hook 0xbc64100
  5299. -66> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command config show hook 0xbc64100
  5300. -65> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command config help hook 0xbc64100
  5301. -64> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command config set hook 0xbc64100
  5302. -63> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command config unset hook 0xbc64100
  5303. -62> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command config get hook 0xbc64100
  5304. -61> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command config diff hook 0xbc64100
  5305. -60> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command config diff get hook 0xbc64100
  5306. -59> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command log flush hook 0xbc64100
  5307. -58> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command log dump hook 0xbc64100
  5308. -57> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command log reopen hook 0xbc64100
  5309. -56> 2020-08-27 14:41:39.705 7f3130c89c00 5 asok(0xbd2a000) register_command dump_mempools hook 0xc922068
  5310. -55> 2020-08-27 14:41:39.717 7f3130c89c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  5311. -54> 2020-08-27 14:41:39.717 7f3130c89c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3571533
  5312. -53> 2020-08-27 14:41:39.717 7f3130c89c00 0 pidfile_write: ignore empty --pid-file
  5313. -52> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5314. -51> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5315. -50> 2020-08-27 14:41:39.721 7f3130c89c00 0 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5316. -49> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5317. -48> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  5318. -47> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  5319. -46> 2020-08-27 14:41:39.721 7f3130c89c00 0 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  5320. -45> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5321. -44> 2020-08-27 14:41:39.721 7f3130c89c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  5322. -43> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5323. -42> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5324. -41> 2020-08-27 14:41:39.721 7f3130c89c00 0 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5325. -40> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5326. -39> 2020-08-27 14:41:39.721 7f3130c89c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  5327. -38> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  5328. -37> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  5329. -36> 2020-08-27 14:41:39.721 7f3130c89c00 0 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  5330. -35> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5331. -34> 2020-08-27 14:41:39.721 7f3130c89c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  5332. -33> 2020-08-27 14:41:39.721 7f3130c89c00 1 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.wal) close
  5333. -32> 2020-08-27 14:41:40.045 7f3130c89c00 1 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block.db) close
  5334. -31> 2020-08-27 14:41:40.309 7f3130c89c00 1 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block) close
  5335. -30> 2020-08-27 14:41:40.525 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) close
  5336. -29> 2020-08-27 14:41:40.781 7f3130c89c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  5337. -28> 2020-08-27 14:41:40.793 7f3130c89c00 0 load: jerasure load: lrc load: isa
  5338. -27> 2020-08-27 14:41:40.793 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5339. -26> 2020-08-27 14:41:40.793 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5340. -25> 2020-08-27 14:41:40.813 7f3130c89c00 0 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5341. -24> 2020-08-27 14:41:40.817 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5342. -23> 2020-08-27 14:41:40.817 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) close
  5343. -22> 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5344. -21> 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5345. -20> 2020-08-27 14:41:41.161 7f3130c89c00 0 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5346. -19> 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5347. -18> 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  5348. -17> 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  5349. -16> 2020-08-27 14:41:41.161 7f3130c89c00 0 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  5350. -15> 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20e00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5351. -14> 2020-08-27 14:41:41.161 7f3130c89c00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  5352. -13> 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5353. -12> 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5354. -11> 2020-08-27 14:41:41.161 7f3130c89c00 0 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5355. -10> 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5356. -9> 2020-08-27 14:41:41.161 7f3130c89c00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  5357. -8> 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  5358. -7> 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  5359. -6> 2020-08-27 14:41:41.161 7f3130c89c00 0 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  5360. -5> 2020-08-27 14:41:41.161 7f3130c89c00 1 bdev(0xca20a80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5361. -4> 2020-08-27 14:41:41.161 7f3130c89c00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  5362. -3> 2020-08-27 14:41:41.161 7f3130c89c00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  5363. -2> 2020-08-27 14:41:41.161 7f3130c89c00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  5364. -1> 2020-08-27 14:41:41.165 7f3130c89c00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f3130c89c00 time 2020-08-27 14:41:41.167941
  5365. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  5366.  
  5367. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  5368. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  5369. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  5370. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  5371. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  5372. 5: (OSD::init()+0x3f3) [0x8f5483]
  5373. 6: (main()+0x27e2) [0x84c462]
  5374. 7: (__libc_start_main()+0xf0) [0x7f312de3a830]
  5375. 8: (_start()+0x29) [0x880389]
  5376.  
  5377. 0> 2020-08-27 14:41:41.169 7f3130c89c00 -1 *** Caught signal (Aborted) **
  5378. in thread 7f3130c89c00 thread_name:ceph-osd
  5379.  
  5380. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  5381. 1: (()+0x11390) [0x7f312e924390]
  5382. 2: (gsignal()+0x38) [0x7f312de4f428]
  5383. 3: (abort()+0x16a) [0x7f312de5102a]
  5384. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  5385. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  5386. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  5387. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  5388. 8: (OSD::init()+0x3f3) [0x8f5483]
  5389. 9: (main()+0x27e2) [0x84c462]
  5390. 10: (__libc_start_main()+0xf0) [0x7f312de3a830]
  5391. 11: (_start()+0x29) [0x880389]
  5392. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  5393.  
  5394. --- logging levels ---
  5395. 0/ 5 none
  5396. 0/ 0 lockdep
  5397. 0/ 0 context
  5398. 0/ 0 crush
  5399. 1/ 5 mds
  5400. 1/ 5 mds_balancer
  5401. 1/ 5 mds_locker
  5402. 1/ 5 mds_log
  5403. 1/ 5 mds_log_expire
  5404. 1/ 5 mds_migrator
  5405. 0/ 0 buffer
  5406. 0/ 0 timer
  5407. 0/ 0 filer
  5408. 0/ 1 striper
  5409. 0/ 0 objecter
  5410. 0/ 0 rados
  5411. 0/ 0 rbd
  5412. 0/ 5 rbd_mirror
  5413. 0/ 5 rbd_replay
  5414. 0/ 0 journaler
  5415. 0/ 0 objectcacher
  5416. 0/ 0 client
  5417. 0/ 0 osd
  5418. 0/ 0 optracker
  5419. 0/ 0 objclass
  5420. 0/ 0 filestore
  5421. 0/ 0 journal
  5422. 0/ 0 ms
  5423. 0/ 0 mon
  5424. 0/ 0 monc
  5425. 0/ 0 paxos
  5426. 0/ 0 tp
  5427. 0/ 0 auth
  5428. 1/ 5 crypto
  5429. 0/ 0 finisher
  5430. 1/ 1 reserver
  5431. 0/ 0 heartbeatmap
  5432. 0/ 0 perfcounter
  5433. 0/ 0 rgw
  5434. 1/ 5 rgw_sync
  5435. 1/10 civetweb
  5436. 1/ 5 javaclient
  5437. 0/ 0 asok
  5438. 0/ 0 throttle
  5439. 0/ 0 refs
  5440. 1/ 5 xio
  5441. 1/ 5 compressor
  5442. 0/ 0 bluestore
  5443. 1/ 5 bluefs
  5444. 1/ 3 bdev
  5445. 1/ 5 kstore
  5446. 4/ 5 rocksdb
  5447. 4/ 5 leveldb
  5448. 4/ 5 memdb
  5449. 1/ 5 kinetic
  5450. 1/ 5 fuse
  5451. 1/ 5 mgr
  5452. 1/ 5 mgrc
  5453. 1/ 5 dpdk
  5454. 1/ 5 eventtrace
  5455. 1/ 5 prioritycache
  5456. -2/-2 (syslog threshold)
  5457. -1/-1 (stderr threshold)
  5458. max_recent 10000
  5459. max_new 1000
  5460. log_file /var/log/ceph/ceph-osd.108.log
  5461. --- end dump of recent events ---
  5462. 2020-08-27 14:41:41.869 7f08b056ec00 0 set uid:gid to 64045:64045 (ceph:ceph)
  5463. 2020-08-27 14:41:41.869 7f08b056ec00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3572971
  5464. 2020-08-27 14:41:41.869 7f08b056ec00 0 pidfile_write: ignore empty --pid-file
  5465. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5466. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5467. 2020-08-27 14:41:41.873 7f08b056ec00 0 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5468. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5469. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  5470. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  5471. 2020-08-27 14:41:41.873 7f08b056ec00 0 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  5472. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5473. 2020-08-27 14:41:41.873 7f08b056ec00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  5474. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5475. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5476. 2020-08-27 14:41:41.873 7f08b056ec00 0 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5477. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5478. 2020-08-27 14:41:41.873 7f08b056ec00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  5479. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  5480. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  5481. 2020-08-27 14:41:41.873 7f08b056ec00 0 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  5482. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5483. 2020-08-27 14:41:41.873 7f08b056ec00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  5484. 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  5485. 2020-08-27 14:41:42.177 7f08b056ec00 1 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block.db) close
  5486. 2020-08-27 14:41:42.453 7f08b056ec00 1 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block) close
  5487. 2020-08-27 14:41:42.689 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) close
  5488. 2020-08-27 14:41:42.945 7f08b056ec00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  5489. 2020-08-27 14:41:42.953 7f08b056ec00 0 load: jerasure load: lrc load: isa
  5490. 2020-08-27 14:41:42.953 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5491. 2020-08-27 14:41:42.953 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5492. 2020-08-27 14:41:42.953 7f08b056ec00 0 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5493. 2020-08-27 14:41:42.957 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5494. 2020-08-27 14:41:42.957 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) close
  5495. 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5496. 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5497. 2020-08-27 14:41:43.265 7f08b056ec00 0 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5498. 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5499. 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  5500. 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  5501. 2020-08-27 14:41:43.265 7f08b056ec00 0 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  5502. 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5503. 2020-08-27 14:41:43.265 7f08b056ec00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  5504. 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5505. 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5506. 2020-08-27 14:41:43.265 7f08b056ec00 0 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5507. 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5508. 2020-08-27 14:41:43.265 7f08b056ec00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  5509. 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  5510. 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  5511. 2020-08-27 14:41:43.265 7f08b056ec00 0 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  5512. 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5513. 2020-08-27 14:41:43.265 7f08b056ec00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  5514. 2020-08-27 14:41:43.265 7f08b056ec00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  5515. 2020-08-27 14:41:43.265 7f08b056ec00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  5516. 2020-08-27 14:41:43.269 7f08b056ec00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f08b056ec00 time 2020-08-27 14:41:43.271404
  5517. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  5518.  
  5519. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  5520. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  5521. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  5522. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  5523. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  5524. 5: (OSD::init()+0x3f3) [0x8f5483]
  5525. 6: (main()+0x27e2) [0x84c462]
  5526. 7: (__libc_start_main()+0xf0) [0x7f08ad71f830]
  5527. 8: (_start()+0x29) [0x880389]
  5528.  
  5529. 2020-08-27 14:41:43.273 7f08b056ec00 -1 *** Caught signal (Aborted) **
  5530. in thread 7f08b056ec00 thread_name:ceph-osd
  5531.  
  5532. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  5533. 1: (()+0x11390) [0x7f08ae209390]
  5534. 2: (gsignal()+0x38) [0x7f08ad734428]
  5535. 3: (abort()+0x16a) [0x7f08ad73602a]
  5536. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  5537. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  5538. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  5539. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  5540. 8: (OSD::init()+0x3f3) [0x8f5483]
  5541. 9: (main()+0x27e2) [0x84c462]
  5542. 10: (__libc_start_main()+0xf0) [0x7f08ad71f830]
  5543. 11: (_start()+0x29) [0x880389]
  5544. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  5545.  
  5546. --- begin dump of recent events ---
  5547. -77> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command assert hook 0xa8c4100
  5548. -76> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command abort hook 0xa8c4100
  5549. -75> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command perfcounters_dump hook 0xa8c4100
  5550. -74> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command 1 hook 0xa8c4100
  5551. -73> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command perf dump hook 0xa8c4100
  5552. -72> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command perfcounters_schema hook 0xa8c4100
  5553. -71> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command perf histogram dump hook 0xa8c4100
  5554. -70> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command 2 hook 0xa8c4100
  5555. -69> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command perf schema hook 0xa8c4100
  5556. -68> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command perf histogram schema hook 0xa8c4100
  5557. -67> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command perf reset hook 0xa8c4100
  5558. -66> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command config show hook 0xa8c4100
  5559. -65> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command config help hook 0xa8c4100
  5560. -64> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command config set hook 0xa8c4100
  5561. -63> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command config unset hook 0xa8c4100
  5562. -62> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command config get hook 0xa8c4100
  5563. -61> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command config diff hook 0xa8c4100
  5564. -60> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command config diff get hook 0xa8c4100
  5565. -59> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command log flush hook 0xa8c4100
  5566. -58> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command log dump hook 0xa8c4100
  5567. -57> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command log reopen hook 0xa8c4100
  5568. -56> 2020-08-27 14:41:41.861 7f08b056ec00 5 asok(0xa98a000) register_command dump_mempools hook 0xb582068
  5569. -55> 2020-08-27 14:41:41.869 7f08b056ec00 0 set uid:gid to 64045:64045 (ceph:ceph)
  5570. -54> 2020-08-27 14:41:41.869 7f08b056ec00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 3572971
  5571. -53> 2020-08-27 14:41:41.869 7f08b056ec00 0 pidfile_write: ignore empty --pid-file
  5572. -52> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5573. -51> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5574. -50> 2020-08-27 14:41:41.873 7f08b056ec00 0 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5575. -49> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5576. -48> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  5577. -47> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  5578. -46> 2020-08-27 14:41:41.873 7f08b056ec00 0 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  5579. -45> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5580. -44> 2020-08-27 14:41:41.873 7f08b056ec00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  5581. -43> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5582. -42> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5583. -41> 2020-08-27 14:41:41.873 7f08b056ec00 0 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5584. -40> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5585. -39> 2020-08-27 14:41:41.873 7f08b056ec00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  5586. -38> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  5587. -37> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  5588. -36> 2020-08-27 14:41:41.873 7f08b056ec00 0 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  5589. -35> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5590. -34> 2020-08-27 14:41:41.873 7f08b056ec00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  5591. -33> 2020-08-27 14:41:41.873 7f08b056ec00 1 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.wal) close
  5592. -32> 2020-08-27 14:41:42.177 7f08b056ec00 1 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block.db) close
  5593. -31> 2020-08-27 14:41:42.453 7f08b056ec00 1 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block) close
  5594. -30> 2020-08-27 14:41:42.689 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) close
  5595. -29> 2020-08-27 14:41:42.945 7f08b056ec00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  5596. -28> 2020-08-27 14:41:42.953 7f08b056ec00 0 load: jerasure load: lrc load: isa
  5597. -27> 2020-08-27 14:41:42.953 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5598. -26> 2020-08-27 14:41:42.953 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5599. -25> 2020-08-27 14:41:42.953 7f08b056ec00 0 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5600. -24> 2020-08-27 14:41:42.957 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5601. -23> 2020-08-27 14:41:42.957 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) close
  5602. -22> 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5603. -21> 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5604. -20> 2020-08-27 14:41:43.265 7f08b056ec00 0 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5605. -19> 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67c000 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5606. -18> 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.db type kernel
  5607. -17> 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.db) open path /var/lib/ceph/osd/ceph-108/block.db
  5608. -16> 2020-08-27 14:41:43.265 7f08b056ec00 0 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.db failed: (22) Invalid argument
  5609. -15> 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67ce00 /var/lib/ceph/osd/ceph-108/block.db) open size 32212254720 (0x780000000, 30 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5610. -14> 2020-08-27 14:41:43.265 7f08b056ec00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-108/block.db size 30 GiB
  5611. -13> 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5612. -12> 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5613. -11> 2020-08-27 14:41:43.265 7f08b056ec00 0 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block failed: (22) Invalid argument
  5614. -10> 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67c700 /var/lib/ceph/osd/ceph-108/block) open size 4000681103360 (0x3a37b2d1000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  5615. -9> 2020-08-27 14:41:43.265 7f08b056ec00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-108/block size 3.6 TiB
  5616. -8> 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev create path /var/lib/ceph/osd/ceph-108/block.wal type kernel
  5617. -7> 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block.wal) open path /var/lib/ceph/osd/ceph-108/block.wal
  5618. -6> 2020-08-27 14:41:43.265 7f08b056ec00 0 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-108/block.wal failed: (22) Invalid argument
  5619. -5> 2020-08-27 14:41:43.265 7f08b056ec00 1 bdev(0xb67ca80 /var/lib/ceph/osd/ceph-108/block.wal) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  5620. -4> 2020-08-27 14:41:43.265 7f08b056ec00 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-108/block.wal size 1 GiB
  5621. -3> 2020-08-27 14:41:43.265 7f08b056ec00 0 set rocksdb option compaction_style = kCompactionStyleLevel
  5622. -2> 2020-08-27 14:41:43.265 7f08b056ec00 -1 rocksdb: Invalid argument: Can't parse option compaction_threads
  5623. -1> 2020-08-27 14:41:43.269 7f08b056ec00 -1 /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: In function 'int BlueStore::_upgrade_super()' thread 7f08b056ec00 time 2020-08-27 14:41:43.271404
  5624. /build/ceph-14.2.11/src/os/bluestore/BlueStore.cc: 10249: FAILED ceph_assert(ondisk_format > 0)
  5625.  
  5626. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  5627. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x846368]
  5628. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  5629. 3: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  5630. 4: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  5631. 5: (OSD::init()+0x3f3) [0x8f5483]
  5632. 6: (main()+0x27e2) [0x84c462]
  5633. 7: (__libc_start_main()+0xf0) [0x7f08ad71f830]
  5634. 8: (_start()+0x29) [0x880389]
  5635.  
  5636. 0> 2020-08-27 14:41:43.273 7f08b056ec00 -1 *** Caught signal (Aborted) **
  5637. in thread 7f08b056ec00 thread_name:ceph-osd
  5638.  
  5639. ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable)
  5640. 1: (()+0x11390) [0x7f08ae209390]
  5641. 2: (gsignal()+0x38) [0x7f08ad734428]
  5642. 3: (abort()+0x16a) [0x7f08ad73602a]
  5643. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x8463b9]
  5644. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x846543]
  5645. 6: (BlueStore::_upgrade_super()+0x4b6) [0xd62346]
  5646. 7: (BlueStore::_mount(bool, bool)+0x592) [0xdb0b52]
  5647. 8: (OSD::init()+0x3f3) [0x8f5483]
  5648. 9: (main()+0x27e2) [0x84c462]
  5649. 10: (__libc_start_main()+0xf0) [0x7f08ad71f830]
  5650. 11: (_start()+0x29) [0x880389]
  5651. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  5652.  
  5653. --- logging levels ---
  5654. 0/ 5 none
  5655. 0/ 0 lockdep
  5656. 0/ 0 context
  5657. 0/ 0 crush
  5658. 1/ 5 mds
  5659. 1/ 5 mds_balancer
  5660. 1/ 5 mds_locker
  5661. 1/ 5 mds_log
  5662. 1/ 5 mds_log_expire
  5663. 1/ 5 mds_migrator
  5664. 0/ 0 buffer
  5665. 0/ 0 timer
  5666. 0/ 0 filer
  5667. 0/ 1 striper
  5668. 0/ 0 objecter
  5669. 0/ 0 rados
  5670. 0/ 0 rbd
  5671. 0/ 5 rbd_mirror
  5672. 0/ 5 rbd_replay
  5673. 0/ 0 journaler
  5674. 0/ 0 objectcacher
  5675. 0/ 0 client
  5676. 0/ 0 osd
  5677. 0/ 0 optracker
  5678. 0/ 0 objclass
  5679. 0/ 0 filestore
  5680. 0/ 0 journal
  5681. 0/ 0 ms
  5682. 0/ 0 mon
  5683. 0/ 0 monc
  5684. 0/ 0 paxos
  5685. 0/ 0 tp
  5686. 0/ 0 auth
  5687. 1/ 5 crypto
  5688. 0/ 0 finisher
  5689. 1/ 1 reserver
  5690. 0/ 0 heartbeatmap
  5691. 0/ 0 perfcounter
  5692. 0/ 0 rgw
  5693. 1/ 5 rgw_sync
  5694. 1/10 civetweb
  5695. 1/ 5 javaclient
  5696. 0/ 0 asok
  5697. 0/ 0 throttle
  5698. 0/ 0 refs
  5699. 1/ 5 xio
  5700. 1/ 5 compressor
  5701. 0/ 0 bluestore
  5702. 1/ 5 bluefs
  5703. 1/ 3 bdev
  5704. 1/ 5 kstore
  5705. 4/ 5 rocksdb
  5706. 4/ 5 leveldb
  5707. 4/ 5 memdb
  5708. 1/ 5 kinetic
  5709. 1/ 5 fuse
  5710. 1/ 5 mgr
  5711. 1/ 5 mgrc
  5712. 1/ 5 dpdk
  5713. 1/ 5 eventtrace
  5714. 1/ 5 prioritycache
  5715. -2/-2 (syslog threshold)
  5716. -1/-1 (stderr threshold)
  5717. max_recent 10000
  5718. max_new 1000
  5719. log_file /var/log/ceph/ceph-osd.108.log
  5720. --- end dump of recent events ---
  5721. 2020-08-27 20:18:38.409 7fc8d3264c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  5722. 2020-08-27 20:18:38.409 7fc8d3264c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 345777
  5723. 2020-08-27 20:18:38.409 7fc8d3264c00 0 pidfile_write: ignore empty --pid-file
  5724. 2020-08-27 20:18:38.413 7fc8d3264c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5725. 2020-08-27 20:18:38.413 7fc8d3264c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5726. 2020-08-27 20:18:38.413 7fc8d3264c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5727. 2020-08-27 20:18:38.413 7fc8d3264c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5728. 2020-08-27 20:18:38.413 7fc8d3264c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5729. 2020-08-27 20:18:38.413 7fc8d3264c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5730. 2020-08-27 20:18:38.413 7fc8d3264c00 1 bdev(0xb666000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5731. 2020-08-27 20:18:38.413 7fc8d3264c00 -1 bdev(0xb666000 /var/lib/ceph/osd/ceph-108/block) open open got: (13) Permission denied
  5732. 2020-08-27 20:18:38.413 7fc8d3264c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  5733. 2020-08-27 20:18:38.449 7fc8d3264c00 0 load: jerasure load: lrc load: isa
  5734. 2020-08-27 20:18:38.449 7fc8d3264c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5735. 2020-08-27 20:18:38.449 7fc8d3264c00 1 bdev(0xb666000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5736. 2020-08-27 20:18:38.449 7fc8d3264c00 -1 bdev(0xb666000 /var/lib/ceph/osd/ceph-108/block) open open got: (13) Permission denied
  5737. 2020-08-27 20:18:38.453 7fc8d3264c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5738. 2020-08-27 20:18:38.453 7fc8d3264c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5739. 2020-08-27 20:18:38.453 7fc8d3264c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5740. 2020-08-27 20:18:38.453 7fc8d3264c00 1 bdev(0xb666000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5741. 2020-08-27 20:18:38.453 7fc8d3264c00 -1 bdev(0xb666000 /var/lib/ceph/osd/ceph-108/block) open open got: (13) Permission denied
  5742. 2020-08-27 20:18:38.453 7fc8d3264c00 -1 osd.108 0 OSD:init: unable to mount object store
  5743. 2020-08-27 20:18:38.453 7fc8d3264c00 -1  ** ERROR: osd init failed: (13) Permission denied
  5744. 2020-08-27 20:18:38.825 7f13d1e20c00 0 set uid:gid to 64045:64045 (ceph:ceph)
  5745. 2020-08-27 20:18:38.825 7f13d1e20c00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 345841
  5746. 2020-08-27 20:18:38.825 7f13d1e20c00 0 pidfile_write: ignore empty --pid-file
  5747. 2020-08-27 20:18:38.825 7f13d1e20c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5748. 2020-08-27 20:18:38.825 7f13d1e20c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5749. 2020-08-27 20:18:38.825 7f13d1e20c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5750. 2020-08-27 20:18:38.825 7f13d1e20c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5751. 2020-08-27 20:18:38.825 7f13d1e20c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5752. 2020-08-27 20:18:38.825 7f13d1e20c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5753. 2020-08-27 20:18:38.825 7f13d1e20c00 1 bdev(0xd28c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5754. 2020-08-27 20:18:38.825 7f13d1e20c00 -1 bdev(0xd28c000 /var/lib/ceph/osd/ceph-108/block) open open got: (13) Permission denied
  5755. 2020-08-27 20:18:38.829 7f13d1e20c00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  5756. 2020-08-27 20:18:38.841 7f13d1e20c00 0 load: jerasure load: lrc load: isa
  5757. 2020-08-27 20:18:38.841 7f13d1e20c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5758. 2020-08-27 20:18:38.841 7f13d1e20c00 1 bdev(0xd28c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5759. 2020-08-27 20:18:38.841 7f13d1e20c00 -1 bdev(0xd28c000 /var/lib/ceph/osd/ceph-108/block) open open got: (13) Permission denied
  5760. 2020-08-27 20:18:38.841 7f13d1e20c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5761. 2020-08-27 20:18:38.841 7f13d1e20c00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5762. 2020-08-27 20:18:38.841 7f13d1e20c00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5763. 2020-08-27 20:18:38.841 7f13d1e20c00 1 bdev(0xd28c000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5764. 2020-08-27 20:18:38.841 7f13d1e20c00 -1 bdev(0xd28c000 /var/lib/ceph/osd/ceph-108/block) open open got: (13) Permission denied
  5765. 2020-08-27 20:18:38.841 7f13d1e20c00 -1 osd.108 0 OSD:init: unable to mount object store
  5766. 2020-08-27 20:18:38.841 7f13d1e20c00 -1  ** ERROR: osd init failed: (13) Permission denied
  5767. 2020-08-27 20:18:39.309 7fe9410bfc00 0 set uid:gid to 64045:64045 (ceph:ceph)
  5768. 2020-08-27 20:18:39.309 7fe9410bfc00 0 ceph version 14.2.11 (f7fdb2f52131f54b891a2ec99d8205561242cdaf) nautilus (stable), process ceph-osd, pid 345903
  5769. 2020-08-27 20:18:39.309 7fe9410bfc00 0 pidfile_write: ignore empty --pid-file
  5770. 2020-08-27 20:18:39.309 7fe9410bfc00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5771. 2020-08-27 20:18:39.309 7fe9410bfc00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5772. 2020-08-27 20:18:39.309 7fe9410bfc00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5773. 2020-08-27 20:18:39.309 7fe9410bfc00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5774. 2020-08-27 20:18:39.309 7fe9410bfc00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5775. 2020-08-27 20:18:39.309 7fe9410bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5776. 2020-08-27 20:18:39.309 7fe9410bfc00 1 bdev(0xd1be000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5777. 2020-08-27 20:18:39.309 7fe9410bfc00 -1 bdev(0xd1be000 /var/lib/ceph/osd/ceph-108/block) open open got: (13) Permission denied
  5778. 2020-08-27 20:18:39.309 7fe9410bfc00 0 starting osd.108 osd_data /var/lib/ceph/osd/ceph-108 /var/lib/ceph/osd/ceph-108/journal
  5779. 2020-08-27 20:18:39.317 7fe9410bfc00 0 load: jerasure load: lrc load: isa
  5780. 2020-08-27 20:18:39.317 7fe9410bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5781. 2020-08-27 20:18:39.317 7fe9410bfc00 1 bdev(0xd1be000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5782. 2020-08-27 20:18:39.317 7fe9410bfc00 -1 bdev(0xd1be000 /var/lib/ceph/osd/ceph-108/block) open open got: (13) Permission denied
  5783. 2020-08-27 20:18:39.317 7fe9410bfc00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5784. 2020-08-27 20:18:39.317 7fe9410bfc00 -1 bluestore(/var/lib/ceph/osd/ceph-108/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-108/block: (13) Permission denied
  5785. 2020-08-27 20:18:39.317 7fe9410bfc00 1 bdev create path /var/lib/ceph/osd/ceph-108/block type kernel
  5786. 2020-08-27 20:18:39.317 7fe9410bfc00 1 bdev(0xd1be000 /var/lib/ceph/osd/ceph-108/block) open path /var/lib/ceph/osd/ceph-108/block
  5787. 2020-08-27 20:18:39.317 7fe9410bfc00 -1 bdev(0xd1be000 /var/lib/ceph/osd/ceph-108/block) open open got: (13) Permission denied
  5788. 2020-08-27 20:18:39.317 7fe9410bfc00 -1 osd.108 0 OSD:init: unable to mount object store
  5789. 2020-08-27 20:18:39.317 7fe9410bfc00 -1  ** ERROR: osd init failed: (13) Permission denied
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!