API tools faq
paste
Guest User

ceph-objectstore-tool output

a guest
Oct 31st, 2019
852
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 123.15 KB | None | 0 0
raw download clone embed print report
  1. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _mount path /var/lib/ceph/osd/ceph-22
  2. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
  3. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecc380 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
  4. 2019-10-31 09:59:59.625 7f1a8f3bda40 0 bdev(0x3ecc380 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
  5. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecc380 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
  6. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  7. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev create path /var/lib/ceph/osd/ceph-22/block.db type kernel
  8. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecca80 /var/lib/ceph/osd/ceph-22/block.db) open path /var/lib/ceph/osd/ceph-22/block.db
  9. 2019-10-31 09:59:59.625 7f1a8f3bda40 0 bdev(0x3ecca80 /var/lib/ceph/osd/ceph-22/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.db failed: (22) Invalid argument
  10. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecca80 /var/lib/ceph/osd/ceph-22/block.db) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  11. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-22/block.db size 1 GiB
  12. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
  13. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecce00 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
  14. 2019-10-31 09:59:59.625 7f1a8f3bda40 0 bdev(0x3ecce00 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
  15. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecce00 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
  16. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-22/block size 5.5 TiB
  17. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev create path /var/lib/ceph/osd/ceph-22/block.wal type kernel
  18. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecd180 /var/lib/ceph/osd/ceph-22/block.wal) open path /var/lib/ceph/osd/ceph-22/block.wal
  19. 2019-10-31 09:59:59.625 7f1a8f3bda40 0 bdev(0x3ecd180 /var/lib/ceph/osd/ceph-22/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.wal failed: (22) Invalid argument
  20. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecd180 /var/lib/ceph/osd/ceph-22/block.wal) open size 603979776 (0x24000000, 576 MiB) block_size 4096 (4 KiB) non-rotational discard supported
  21. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-22/block.wal size 576 MiB
  22. 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluefs mount
  23. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option compaction_readahead_size = 2097152
  24. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option compression = kNoCompression
  25. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option max_background_compactions = 2
  26. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option max_write_buffer_number = 4
  27. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option min_write_buffer_number_to_merge = 1
  28. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option recycle_log_file_num = 4
  29. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option writable_file_max_buffer_size = 0
  30. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option write_buffer_size = 268435456
  31. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option compaction_readahead_size = 2097152
  32. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option compression = kNoCompression
  33. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option max_background_compactions = 2
  34. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option max_write_buffer_number = 4
  35. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option min_write_buffer_number_to_merge = 1
  36. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option recycle_log_file_num = 4
  37. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option writable_file_max_buffer_size = 0
  38. 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option write_buffer_size = 268435456
  39. 2019-10-31 09:59:59.657 7f1a8f3bda40 1 rocksdb: do_open column families: [default]
  40. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: RocksDB version: 6.1.2
  41.  
  42. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  43. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Compile date Sep 13 2019
  44. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: DB SUMMARY
  45.  
  46. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: CURRENT file: CURRENT
  47.  
  48. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: IDENTITY file: IDENTITY
  49.  
  50. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: MANIFEST file: MANIFEST-034878 size: 269419 Bytes
  51.  
  52. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: SST files in db dir, Total Num: 7, files: 036855.sst 036856.sst 036858.sst 036859.sst 036886.sst 036888.sst 036890.sst
  53.  
  54. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: SST files in db.slow dir, Total Num: 182, files: 033490.sst 033491.sst 033632.sst 034662.sst 034717.sst 034718.sst 034719.sst 034769.sst 034770.sst
  55.  
  56. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Write Ahead Log file in db.wal: 036887.log size: 253533899 ; 036889.log size: 255973165 ;
  57.  
  58. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.error_if_exists: 0
  59. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.create_if_missing: 0
  60. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.paranoid_checks: 1
  61. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.env: 0x3ecaa60
  62. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.info_log: 0x3ef4f80
  63. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_file_opening_threads: 16
  64. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.statistics: (nil)
  65. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.use_fsync: 0
  66. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_log_file_size: 0
  67. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_manifest_file_size: 1073741824
  68. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.log_file_time_to_roll: 0
  69. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.keep_log_file_num: 1000
  70. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.recycle_log_file_num: 4
  71. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_fallocate: 1
  72. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_mmap_reads: 0
  73. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_mmap_writes: 0
  74. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.use_direct_reads: 0
  75. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  76. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.create_missing_column_families: 0
  77. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.db_log_dir:
  78. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.wal_dir: db.wal
  79. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.table_cache_numshardbits: 6
  80. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_subcompactions: 1
  81. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_background_flushes: -1
  82. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.WAL_ttl_seconds: 0
  83. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.WAL_size_limit_MB: 0
  84. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.manifest_preallocation_size: 4194304
  85. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.is_fd_close_on_exec: 1
  86. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.advise_random_on_open: 1
  87. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.db_write_buffer_size: 0
  88. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.write_buffer_manager: 0x3edef00
  89. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.access_hint_on_compaction_start: 1
  90. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  91. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  92. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.use_adaptive_mutex: 0
  93. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.rate_limiter: (nil)
  94. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  95. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.wal_recovery_mode: 0
  96. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.enable_thread_tracking: 0
  97. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.enable_pipelined_write: 0
  98. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  99. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  100. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.write_thread_max_yield_usec: 100
  101. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  102. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.row_cache: None
  103. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.wal_filter: None
  104. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.avoid_flush_during_recovery: 0
  105. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_ingest_behind: 0
  106. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.preserve_deletes: 0
  107. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.two_write_queues: 0
  108. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.manual_wal_flush: 0
  109. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.atomic_flush: 0
  110. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  111. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_background_jobs: 2
  112. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_background_compactions: 2
  113. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  114. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.writable_file_max_buffer_size: 0
  115. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.delayed_write_rate : 16777216
  116. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_total_wal_size: 0
  117. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  118. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.stats_dump_period_sec: 600
  119. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.stats_persist_period_sec: 600
  120. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.stats_history_buffer_size: 1048576
  121. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_open_files: -1
  122. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bytes_per_sync: 0
  123. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.wal_bytes_per_sync: 0
  124. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_readahead_size: 2097152
  125. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Compression algorithms supported:
  126. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kZSTDNotFinalCompression supported: 0
  127. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kZSTD supported: 0
  128. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kXpressCompression supported: 0
  129. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kLZ4HCCompression supported: 1
  130. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kLZ4Compression supported: 1
  131. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kBZip2Compression supported: 0
  132. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kZlibCompression supported: 1
  133. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kSnappyCompression supported: 1
  134. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Fast CRC32 supported: Supported on x86
  135. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: [db/db_impl_readonly.cc:22] Opening the db in read only mode
  136. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-034878
  137.  
  138. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  139.  
  140. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  141. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  142. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_filter: None
  143. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_filter_factory: None
  144. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_factory: SkipListFactory
  145. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.table_factory: BlockBasedTable
  146. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x321ef40)
  147. cache_index_and_filter_blocks: 1
  148. cache_index_and_filter_blocks_with_high_priority: 1
  149. pin_l0_filter_and_index_blocks_in_cache: 1
  150. pin_top_level_index_and_filter: 1
  151. index_type: 0
  152. data_block_index_type: 0
  153. data_block_hash_table_util_ratio: 0.750000
  154. hash_index_allow_collision: 1
  155. checksum: 1
  156. no_block_cache: 0
  157. block_cache: 0x322e250
  158. block_cache_name: BinnedLRUCache
  159. block_cache_options:
  160. capacity : 429496729
  161. num_shard_bits : 4
  162. strict_capacity_limit : 0
  163. high_pri_pool_ratio: 0.000
  164. block_cache_compressed: (nil)
  165. persistent_cache: (nil)
  166. block_size: 4096
  167. block_size_deviation: 10
  168. block_restart_interval: 16
  169. index_block_restart_interval: 1
  170. metadata_block_size: 4096
  171. partition_filters: 0
  172. use_delta_encoding: 1
  173. filter_policy: rocksdb.BuiltinBloomFilter
  174. whole_key_filtering: 1
  175. verify_compression: 0
  176. read_amp_bytes_per_bit: 0
  177. format_version: 2
  178. enable_index_compression: 1
  179. block_align: 0
  180.  
  181. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.write_buffer_size: 268435456
  182. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_write_buffer_number: 4
  183. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression: NoCompression
  184. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression: Disabled
  185. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.prefix_extractor: nullptr
  186. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  187. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.num_levels: 7
  188. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  189. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  190. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  191. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  192. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  193. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  194. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  195. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  196. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.window_bits: -14
  197. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.level: 32767
  198. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.strategy: 0
  199. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  200. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  201. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.enabled: false
  202. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  203. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  204. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.level0_stop_writes_trigger: 36
  205. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.target_file_size_base: 67108864
  206. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.target_file_size_multiplier: 1
  207. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  208. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  209. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  210. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  211. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  212. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  213. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  214. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  215. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  216. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  217. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  218. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_compaction_bytes: 1677721600
  219. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.arena_block_size: 33554432
  220. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  221. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  222. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  223. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.disable_auto_compactions: 0
  224. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  225. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  226. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  227. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  228. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  229. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  230. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  231. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  232. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  233. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  234. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.table_properties_collectors:
  235. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.inplace_update_support: 0
  236. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.inplace_update_num_locks: 10000
  237. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  238. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_whole_key_filtering: 0
  239. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_huge_page_size: 0
  240. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bloom_locality: 0
  241. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_successive_merges: 0
  242. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.optimize_filters_for_hits: 0
  243. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.paranoid_file_checks: 0
  244. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.force_consistency_checks: 0
  245. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.report_bg_io_stats: 0
  246. 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.ttl: 0
  247. 2019-10-31 09:59:59.661 7f1a76b67700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 177636318 in db/036858.sst offset 18446744073709551615 size 18446744073709551615
  248. 2019-10-31 09:59:59.661 7f1a78b6b700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 2028823508 in db/036890.sst offset 18446744073709551615 size 18446744073709551615
  249. 2019-10-31 09:59:59.661 7f1a7836a700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 994402680 in db/036888.sst offset 18446744073709551615 size 18446744073709551615
  250. 2019-10-31 09:59:59.661 7f1a77b69700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 581611736 in db/036886.sst offset 18446744073709551615 size 18446744073709551615
  251. 2019-10-31 09:59:59.697 7f1a75364700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 184561374 in db.slow/036824.sst offset 18446744073709551615 size 18446744073709551615
  252. 2019-10-31 09:59:59.753 7f1a8f3bda40 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-034878 succeeded,manifest_file_number is 34878, next_file_number is 36892, last_sequence is 1244403827, log_number is 36889,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  253.  
  254. 2019-10-31 09:59:59.753 7f1a8f3bda40 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 36889
  255.  
  256. 2019-10-31 09:59:59.753 7f1a8f3bda40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1572508799759786, "job": 1, "event": "recovery_started", "log_files": [36887, 36889]}
  257. 2019-10-31 09:59:59.753 7f1a8f3bda40 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #36887 mode 0
  258. 2019-10-31 10:00:00.413 7f1a8f3bda40 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #36889 mode 0
  259. 2019-10-31 10:00:02.233 7f1a8f3bda40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1572508802239862, "job": 1, "event": "recovery_finished"}
  260. 2019-10-31 10:00:02.233 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  261. 2019-10-31 10:00:02.329 7f1a8f3bda40 1 freelist init
  262. 2019-10-31 10:00:02.385 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _open_alloc opening allocation metadata
  263. 2019-10-31 10:00:02.401 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _open_alloc loaded 0 B in 0 extents
  264. /build/ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: In function 'void AllocatorLevel02<T>::_mark_allocated(uint64_t, uint64_t) [with L1 = AllocatorLevel01Loose; uint64_t = long unsigned int]' thread 7f1a8f3bda40 time 2019-10-31 10:00:02.403922
  265. /build/ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(available >= allocated)
  266. ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable)
  267. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f1a8519c64e]
  268. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a8519c829]
  269. 3: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0xd2919c]
  270. 4: (BlueStore::_open_alloc()+0x445) [0xbdbc45]
  271. 5: (BlueStore::_open_db_and_around(bool)+0x146) [0xbf6c96]
  272. 6: (BlueStore::_mount(bool, bool)+0x68a) [0xc42e5a]
  273. 7: (main()+0x2f1c) [0x6ac3fc]
  274. 8: (__libc_start_main()+0xf0) [0x7f1a83f9d830]
  275. 9: (_start()+0x29) [0x6d9179]
  276. *** Caught signal (Aborted) **
  277. in thread 7f1a8f3bda40 thread_name:ceph-objectstor
  278. 2019-10-31 10:00:02.401 7f1a8f3bda40 -1 /build/ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: In function 'void AllocatorLevel02<T>::_mark_allocated(uint64_t, uint64_t) [with L1 = AllocatorLevel01Loose; uint64_t = long unsigned int]' thread 7f1a8f3bda40 time 2019-10-31 10:00:02.403922
  279. /build/ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(available >= allocated)
  280.  
  281. ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable)
  282. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f1a8519c64e]
  283. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a8519c829]
  284. 3: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0xd2919c]
  285. 4: (BlueStore::_open_alloc()+0x445) [0xbdbc45]
  286. 5: (BlueStore::_open_db_and_around(bool)+0x146) [0xbf6c96]
  287. 6: (BlueStore::_mount(bool, bool)+0x68a) [0xc42e5a]
  288. 7: (main()+0x2f1c) [0x6ac3fc]
  289. 8: (__libc_start_main()+0xf0) [0x7f1a83f9d830]
  290. 9: (_start()+0x29) [0x6d9179]
  291.  
  292. ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable)
  293. 1: (()+0x11390) [0x7f1a84869390]
  294. 2: (gsignal()+0x38) [0x7f1a83fb2428]
  295. 3: (abort()+0x16a) [0x7f1a83fb402a]
  296. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7f1a8519c69f]
  297. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a8519c829]
  298. 6: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0xd2919c]
  299. 7: (BlueStore::_open_alloc()+0x445) [0xbdbc45]
  300. 8: (BlueStore::_open_db_and_around(bool)+0x146) [0xbf6c96]
  301. 9: (BlueStore::_mount(bool, bool)+0x68a) [0xc42e5a]
  302. 10: (main()+0x2f1c) [0x6ac3fc]
  303. 11: (__libc_start_main()+0xf0) [0x7f1a83f9d830]
  304. 12: (_start()+0x29) [0x6d9179]
  305. 2019-10-31 10:00:02.405 7f1a8f3bda40 -1 *** Caught signal (Aborted) **
  306. in thread 7f1a8f3bda40 thread_name:ceph-objectstor
  307.  
  308. ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable)
  309. 1: (()+0x11390) [0x7f1a84869390]
  310. 2: (gsignal()+0x38) [0x7f1a83fb2428]
  311. 3: (abort()+0x16a) [0x7f1a83fb402a]
  312. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7f1a8519c69f]
  313. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a8519c829]
  314. 6: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0xd2919c]
  315. 7: (BlueStore::_open_alloc()+0x445) [0xbdbc45]
  316. 8: (BlueStore::_open_db_and_around(bool)+0x146) [0xbf6c96]
  317. 9: (BlueStore::_mount(bool, bool)+0x68a) [0xc42e5a]
  318. 10: (main()+0x2f1c) [0x6ac3fc]
  319. 11: (__libc_start_main()+0xf0) [0x7f1a83f9d830]
  320. 12: (_start()+0x29) [0x6d9179]
  321. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  322.  
  323. --- begin dump of recent events ---
  324. -384> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command assert hook 0x3236260
  325. -383> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command abort hook 0x3236260
  326. -382> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perfcounters_dump hook 0x3236260
  327. -381> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command 1 hook 0x3236260
  328. -380> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perf dump hook 0x3236260
  329. -379> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perfcounters_schema hook 0x3236260
  330. -378> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perf histogram dump hook 0x3236260
  331. -377> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command 2 hook 0x3236260
  332. -376> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perf schema hook 0x3236260
  333. -375> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perf histogram schema hook 0x3236260
  334. -374> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perf reset hook 0x3236260
  335. -373> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config show hook 0x3236260
  336. -372> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config help hook 0x3236260
  337. -371> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config set hook 0x3236260
  338. -370> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config unset hook 0x3236260
  339. -369> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config get hook 0x3236260
  340. -368> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config diff hook 0x3236260
  341. -367> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config diff get hook 0x3236260
  342. -366> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command log flush hook 0x3236260
  343. -365> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command log dump hook 0x3236260
  344. -364> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command log reopen hook 0x3236260
  345. -363> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command dump_mempools hook 0x3ec0068
  346. -362> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient: get_monmap_and_config
  347. -361> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient: build_initial_monmap
  348. -360> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient: monmap:
  349. epoch 0
  350. fsid ed7b2c16-b053-45e2-a1fe-bf3474f90508
  351. last_changed 2019-10-31 09:59:59.619828
  352. created 2019-10-31 09:59:59.619828
  353. min_mon_release 0 (unknown)
  354. 0: v1:192.168.6.80:6789/0 mon.noname-a-legacy
  355. 1: v1:192.168.6.81:6789/0 mon.noname-b-legacy
  356. 2: v1:192.168.6.82:6789/0 mon.noname-c-legacy
  357. 3: v2:192.168.6.80:3300/0 mon.noname-a
  358. 4: v2:192.168.6.81:3300/0 mon.noname-b
  359. 5: v2:192.168.6.82:3300/0 mon.noname-c
  360.  
  361. -359> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding auth protocol: cephx
  362. -358> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding auth protocol: cephx
  363. -357> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding auth protocol: cephx
  364. -356> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding auth protocol: none
  365. -355> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: secure
  366. -354> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: crc
  367. -353> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: secure
  368. -352> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: crc
  369. -351> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: secure
  370. -350> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: crc
  371. -349> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: crc
  372. -348> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: secure
  373. -347> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: crc
  374. -346> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: secure
  375. -345> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: crc
  376. -344> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: secure
  377. -343> 2019-10-31 09:59:59.613 7f1a8f3bda40 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
  378. -342> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient: init
  379. -341> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: cephx
  380. -340> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: cephx
  381. -339> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: cephx
  382. -338> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: none
  383. -337> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  384. -336> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  385. -335> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  386. -334> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  387. -333> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  388. -332> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  389. -331> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  390. -330> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  391. -329> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  392. -328> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  393. -327> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  394. -326> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  395. -325> 2019-10-31 09:59:59.613 7f1a8f3bda40 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
  396. -324> 2019-10-31 09:59:59.613 7f1a8f3bda40 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
  397. -323> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient: _reopen_session rank -1
  398. -322> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): picked mon.noname-a-legacy con 0x32abf80 addr v1:192.168.6.80:6789/0
  399. -321> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): picked mon.noname-c con 0x32ac880 addr v2:192.168.6.82:3300/0
  400. -320> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): picked mon.noname-a con 0x32acd00 addr v2:192.168.6.80:3300/0
  401. -319> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): start opening mon connection
  402. -318> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): start opening mon connection
  403. -317> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): _renew_subs
  404. -316> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): authenticate will time out at 2019-10-31 10:04:59.621236
  405. -315> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): get_auth_request con 0x32acd00 auth_method 0
  406. -314> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2]
  407. -313> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): _init_auth method 2
  408. -312> 2019-10-31 09:59:59.617 7f1a8037a700 10 monclient(hunting): get_auth_request con 0x32ac880 auth_method 0
  409. -311> 2019-10-31 09:59:59.617 7f1a8037a700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2]
  410. -310> 2019-10-31 09:59:59.617 7f1a8037a700 10 monclient(hunting): _init_auth method 2
  411. -309> 2019-10-31 09:59:59.617 7f1a8037a700 10 monclient(hunting): handle_auth_reply_more payload 9
  412. -308> 2019-10-31 09:59:59.617 7f1a8037a700 10 monclient(hunting): handle_auth_reply_more payload_len 9
  413. -307> 2019-10-31 09:59:59.617 7f1a8037a700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
  414. -306> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): handle_auth_reply_more payload 9
  415. -305> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): handle_auth_reply_more payload_len 9
  416. -304> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
  417. -303> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): handle_auth_done global_id 21805929 payload 386
  418. -302> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient: _finish_hunting 0
  419. -301> 2019-10-31 09:59:59.617 7f1a8137c700 1 monclient: found mon.noname-a
  420. -300> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient: _send_mon_message to mon.noname-a at v2:192.168.6.80:3300/0
  421. -299> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: handle_monmap mon_map magic: 0 v1
  422. -298> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: got monmap 12 from mon.noname-a (according to old e12)
  423. -297> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: dump:
  424. epoch 12
  425. fsid ed7b2c16-b053-45e2-a1fe-bf3474f90508
  426. last_changed 2019-07-22 11:59:41.402816
  427. created 2016-11-26 14:08:37.372404
  428. min_mon_release 14 (nautilus)
  429. 0: [v2:192.168.6.80:3300/0,v1:192.168.6.80:6789/0] mon.ceph-mon1
  430. 1: [v2:192.168.6.81:3300/0,v1:192.168.6.81:6789/0] mon.ceph-mon2
  431. 2: [v2:192.168.6.82:3300/0,v1:192.168.6.82:6789/0] mon.ceph-mon3
  432.  
  433. -296> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: _finish_auth 0
  434. -295> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2019-10-31 09:59:29.625643)
  435. -294> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: _send_mon_message to mon.ceph-mon1 at v2:192.168.6.80:3300/0
  436. -293> 2019-10-31 09:59:59.621 7f1a8f3bda40 5 monclient: authenticate success, global_id 21805929
  437. -292> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: handle_config config(29 keys) v1
  438. -291> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: handle_monmap mon_map magic: 0 v1
  439. -290> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: got monmap 12 from mon.ceph-mon1 (according to old e12)
  440. -289> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: dump:
  441. epoch 12
  442. fsid ed7b2c16-b053-45e2-a1fe-bf3474f90508
  443. last_changed 2019-07-22 11:59:41.402816
  444. created 2016-11-26 14:08:37.372404
  445. min_mon_release 14 (nautilus)
  446. 0: [v2:192.168.6.80:3300/0,v1:192.168.6.80:6789/0] mon.ceph-mon1
  447. 1: [v2:192.168.6.81:3300/0,v1:192.168.6.81:6789/0] mon.ceph-mon2
  448. 2: [v2:192.168.6.82:3300/0,v1:192.168.6.82:6789/0] mon.ceph-mon3
  449.  
  450. -288> 2019-10-31 09:59:59.621 7f1a7e376700 4 set_mon_vals no callback set
  451. -287> 2019-10-31 09:59:59.621 7f1a8f3bda40 10 monclient: get_monmap_and_config success
  452. -286> 2019-10-31 09:59:59.621 7f1a8f3bda40 10 monclient: shutdown
  453. -285> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals auth_client_required = cephx
  454. -284> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals auth_cluster_required = cephx
  455. -283> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals auth_service_required = cephx
  456. -282> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: _finish_auth 0
  457. -281> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2019-10-31 09:59:29.626182)
  458. -280> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals bluestore_block_db_path = 77309411328
  459. -279> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals bluestore_bluefs_gift_ratio = 0.002000
  460. -278> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals cluster_network = 192.168.7.0/24
  461. -277> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals mds_cache_memory_limit = 4294967296
  462. -276> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals mon_allow_pool_delete = true
  463. -275> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals mon_max_pg_per_osd = 200
  464. -274> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals mon_osd_cache_size = 1024
  465. -273> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals mon_warn_on_misplaced = true
  466. -272> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_client_op_priority = 63
  467. -271> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_max_backfills = 1
  468. -270> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_max_object_name_len = 256
  469. -269> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_max_object_namespace_len = 64
  470. -268> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_max_pg_per_osd_hard_ratio = 1.200000
  471. -267> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_memory_target = 4831838208
  472. -266> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_pool_default_min_size = 2
  473. -265> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_pool_default_pg_num = 128
  474. -264> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_pool_default_pgp_num = 128
  475. -263> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_pool_default_size = 2
  476. -262> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_recovery_max_active = 1
  477. -261> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_recovery_op_priority = 1
  478. -260> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_scrub_during_recovery = true
  479. -259> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals public_network = 192.168.6.0/24
  480. -258> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals rbd_default_features = 1
  481. -257> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals rocksdb_cache_size = 1073741824
  482. -256> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding auth protocol: cephx
  483. -255> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding auth protocol: cephx
  484. -254> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding auth protocol: cephx
  485. -253> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: secure
  486. -252> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: crc
  487. -251> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: secure
  488. -250> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: crc
  489. -249> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: secure
  490. -248> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: crc
  491. -247> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: crc
  492. -246> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: secure
  493. -245> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: crc
  494. -244> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: secure
  495. -243> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: crc
  496. -242> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: secure
  497. -241> 2019-10-31 09:59:59.621 7f1a7e376700 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
  498. -240> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: cephx
  499. -239> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: cephx
  500. -238> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: cephx
  501. -237> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  502. -236> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  503. -235> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  504. -234> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  505. -233> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  506. -232> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  507. -231> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  508. -230> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  509. -229> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  510. -228> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  511. -227> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  512. -226> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  513. -225> 2019-10-31 09:59:59.621 7f1a7e376700 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
  514. -224> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _mount path /var/lib/ceph/osd/ceph-22
  515. -223> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
  516. -222> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecc380 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
  517. -221> 2019-10-31 09:59:59.625 7f1a8f3bda40 0 bdev(0x3ecc380 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
  518. -220> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecc380 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
  519. -219> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  520. -218> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev create path /var/lib/ceph/osd/ceph-22/block.db type kernel
  521. -217> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecca80 /var/lib/ceph/osd/ceph-22/block.db) open path /var/lib/ceph/osd/ceph-22/block.db
  522. -216> 2019-10-31 09:59:59.625 7f1a8f3bda40 0 bdev(0x3ecca80 /var/lib/ceph/osd/ceph-22/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.db failed: (22) Invalid argument
  523. -215> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecca80 /var/lib/ceph/osd/ceph-22/block.db) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  524. -214> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-22/block.db size 1 GiB
  525. -213> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
  526. -212> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecce00 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
  527. -211> 2019-10-31 09:59:59.625 7f1a8f3bda40 0 bdev(0x3ecce00 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
  528. -210> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecce00 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
  529. -209> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-22/block size 5.5 TiB
  530. -208> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev create path /var/lib/ceph/osd/ceph-22/block.wal type kernel
  531. -207> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecd180 /var/lib/ceph/osd/ceph-22/block.wal) open path /var/lib/ceph/osd/ceph-22/block.wal
  532. -206> 2019-10-31 09:59:59.625 7f1a8f3bda40 0 bdev(0x3ecd180 /var/lib/ceph/osd/ceph-22/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.wal failed: (22) Invalid argument
  533. -205> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecd180 /var/lib/ceph/osd/ceph-22/block.wal) open size 603979776 (0x24000000, 576 MiB) block_size 4096 (4 KiB) non-rotational discard supported
  534. -204> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-22/block.wal size 576 MiB
  535. -203> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluefs mount
  536. -202> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option compaction_readahead_size = 2097152
  537. -201> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option compression = kNoCompression
  538. -200> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option max_background_compactions = 2
  539. -199> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option max_write_buffer_number = 4
  540. -198> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option min_write_buffer_number_to_merge = 1
  541. -197> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option recycle_log_file_num = 4
  542. -196> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option writable_file_max_buffer_size = 0
  543. -195> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option write_buffer_size = 268435456
  544. -194> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option compaction_readahead_size = 2097152
  545. -193> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option compression = kNoCompression
  546. -192> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option max_background_compactions = 2
  547. -191> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option max_write_buffer_number = 4
  548. -190> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option min_write_buffer_number_to_merge = 1
  549. -189> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option recycle_log_file_num = 4
  550. -188> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option writable_file_max_buffer_size = 0
  551. -187> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option write_buffer_size = 268435456
  552. -186> 2019-10-31 09:59:59.657 7f1a8f3bda40 1 rocksdb: do_open column families: [default]
  553. -185> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: RocksDB version: 6.1.2
  554.  
  555. -184> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  556. -183> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Compile date Sep 13 2019
  557. -182> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: DB SUMMARY
  558.  
  559. -181> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: CURRENT file: CURRENT
  560.  
  561. -180> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: IDENTITY file: IDENTITY
  562.  
  563. -179> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: MANIFEST file: MANIFEST-034878 size: 269419 Bytes
  564.  
  565. -178> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: SST files in db dir, Total Num: 7, files: 036855.sst 036856.sst 036858.sst 036859.sst 036886.sst 036888.sst 036890.sst
  566.  
  567. -177> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: SST files in db.slow dir, Total Num: 182, files: 033490.sst 033491.sst 033632.sst 034662.sst 034717.sst 034718.sst 034719.sst 034769.sst 034770.sst
  568.  
  569. -176> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Write Ahead Log file in db.wal: 036887.log size: 253533899 ; 036889.log size: 255973165 ;
  570.  
  571. -175> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.error_if_exists: 0
  572. -174> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.create_if_missing: 0
  573. -173> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.paranoid_checks: 1
  574. -172> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.env: 0x3ecaa60
  575. -171> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.info_log: 0x3ef4f80
  576. -170> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_file_opening_threads: 16
  577. -169> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.statistics: (nil)
  578. -168> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.use_fsync: 0
  579. -167> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_log_file_size: 0
  580. -166> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_manifest_file_size: 1073741824
  581. -165> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.log_file_time_to_roll: 0
  582. -164> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.keep_log_file_num: 1000
  583. -163> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.recycle_log_file_num: 4
  584. -162> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_fallocate: 1
  585. -161> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_mmap_reads: 0
  586. -160> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_mmap_writes: 0
  587. -159> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.use_direct_reads: 0
  588. -158> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  589. -157> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.create_missing_column_families: 0
  590. -156> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.db_log_dir:
  591. -155> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.wal_dir: db.wal
  592. -154> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.table_cache_numshardbits: 6
  593. -153> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_subcompactions: 1
  594. -152> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_background_flushes: -1
  595. -151> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.WAL_ttl_seconds: 0
  596. -150> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.WAL_size_limit_MB: 0
  597. -149> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.manifest_preallocation_size: 4194304
  598. -148> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.is_fd_close_on_exec: 1
  599. -147> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.advise_random_on_open: 1
  600. -146> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.db_write_buffer_size: 0
  601. -145> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.write_buffer_manager: 0x3edef00
  602. -144> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.access_hint_on_compaction_start: 1
  603. -143> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  604. -142> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  605. -141> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.use_adaptive_mutex: 0
  606. -140> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.rate_limiter: (nil)
  607. -139> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  608. -138> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.wal_recovery_mode: 0
  609. -137> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.enable_thread_tracking: 0
  610. -136> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.enable_pipelined_write: 0
  611. -135> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  612. -134> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  613. -133> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.write_thread_max_yield_usec: 100
  614. -132> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  615. -131> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.row_cache: None
  616. -130> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.wal_filter: None
  617. -129> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.avoid_flush_during_recovery: 0
  618. -128> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_ingest_behind: 0
  619. -127> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.preserve_deletes: 0
  620. -126> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.two_write_queues: 0
  621. -125> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.manual_wal_flush: 0
  622. -124> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.atomic_flush: 0
  623. -123> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  624. -122> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_background_jobs: 2
  625. -121> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_background_compactions: 2
  626. -120> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  627. -119> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.writable_file_max_buffer_size: 0
  628. -118> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.delayed_write_rate : 16777216
  629. -117> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_total_wal_size: 0
  630. -116> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  631. -115> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.stats_dump_period_sec: 600
  632. -114> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.stats_persist_period_sec: 600
  633. -113> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.stats_history_buffer_size: 1048576
  634. -112> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_open_files: -1
  635. -111> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bytes_per_sync: 0
  636. -110> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.wal_bytes_per_sync: 0
  637. -109> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_readahead_size: 2097152
  638. -108> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Compression algorithms supported:
  639. -107> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kZSTDNotFinalCompression supported: 0
  640. -106> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kZSTD supported: 0
  641. -105> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kXpressCompression supported: 0
  642. -104> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kLZ4HCCompression supported: 1
  643. -103> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kLZ4Compression supported: 1
  644. -102> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kBZip2Compression supported: 0
  645. -101> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kZlibCompression supported: 1
  646. -100> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kSnappyCompression supported: 1
  647. -99> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Fast CRC32 supported: Supported on x86
  648. -98> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: [db/db_impl_readonly.cc:22] Opening the db in read only mode
  649. -97> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-034878
  650.  
  651. -96> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  652.  
  653. -95> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  654. -94> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  655. -93> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_filter: None
  656. -92> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_filter_factory: None
  657. -91> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_factory: SkipListFactory
  658. -90> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.table_factory: BlockBasedTable
  659. -89> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x321ef40)
  660. cache_index_and_filter_blocks: 1
  661. cache_index_and_filter_blocks_with_high_priority: 1
  662. pin_l0_filter_and_index_blocks_in_cache: 1
  663. pin_top_level_index_and_filter: 1
  664. index_type: 0
  665. data_block_index_type: 0
  666. data_block_hash_table_util_ratio: 0.750000
  667. hash_index_allow_collision: 1
  668. checksum: 1
  669. no_block_cache: 0
  670. block_cache: 0x322e250
  671. block_cache_name: BinnedLRUCache
  672. block_cache_options:
  673. capacity : 429496729
  674. num_shard_bits : 4
  675. strict_capacity_limit : 0
  676. high_pri_pool_ratio: 0.000
  677. block_cache_compressed: (nil)
  678. persistent_cache: (nil)
  679. block_size: 4096
  680. block_size_deviation: 10
  681. block_restart_interval: 16
  682. index_block_restart_interval: 1
  683. metadata_block_size: 4096
  684. partition_filters: 0
  685. use_delta_encoding: 1
  686. filter_policy: rocksdb.BuiltinBloomFilter
  687. whole_key_filtering: 1
  688. verify_compression: 0
  689. read_amp_bytes_per_bit: 0
  690. format_version: 2
  691. enable_index_compression: 1
  692. block_align: 0
  693.  
  694. -88> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.write_buffer_size: 268435456
  695. -87> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_write_buffer_number: 4
  696. -86> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression: NoCompression
  697. -85> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression: Disabled
  698. -84> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.prefix_extractor: nullptr
  699. -83> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  700. -82> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.num_levels: 7
  701. -81> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  702. -80> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  703. -79> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  704. -78> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  705. -77> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  706. -76> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  707. -75> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  708. -74> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  709. -73> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.window_bits: -14
  710. -72> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.level: 32767
  711. -71> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.strategy: 0
  712. -70> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  713. -69> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  714. -68> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.enabled: false
  715. -67> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  716. -66> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  717. -65> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.level0_stop_writes_trigger: 36
  718. -64> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.target_file_size_base: 67108864
  719. -63> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.target_file_size_multiplier: 1
  720. -62> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  721. -61> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  722. -60> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  723. -59> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  724. -58> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  725. -57> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  726. -56> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  727. -55> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  728. -54> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  729. -53> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  730. -52> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  731. -51> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_compaction_bytes: 1677721600
  732. -50> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.arena_block_size: 33554432
  733. -49> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  734. -48> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  735. -47> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  736. -46> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.disable_auto_compactions: 0
  737. -45> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  738. -44> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  739. -43> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  740. -42> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  741. -41> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  742. -40> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  743. -39> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  744. -38> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  745. -37> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  746. -36> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  747. -35> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.table_properties_collectors:
  748. -34> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.inplace_update_support: 0
  749. -33> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.inplace_update_num_locks: 10000
  750. -32> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  751. -31> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_whole_key_filtering: 0
  752. -30> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_huge_page_size: 0
  753. -29> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bloom_locality: 0
  754. -28> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_successive_merges: 0
  755. -27> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.optimize_filters_for_hits: 0
  756. -26> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.paranoid_file_checks: 0
  757. -25> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.force_consistency_checks: 0
  758. -24> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.report_bg_io_stats: 0
  759. -23> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.ttl: 0
  760. -22> 2019-10-31 09:59:59.661 7f1a76b67700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 177636318 in db/036858.sst offset 18446744073709551615 size 18446744073709551615
  761. -21> 2019-10-31 09:59:59.661 7f1a78b6b700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 2028823508 in db/036890.sst offset 18446744073709551615 size 18446744073709551615
  762. -20> 2019-10-31 09:59:59.661 7f1a7836a700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 994402680 in db/036888.sst offset 18446744073709551615 size 18446744073709551615
  763. -19> 2019-10-31 09:59:59.661 7f1a77b69700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 581611736 in db/036886.sst offset 18446744073709551615 size 18446744073709551615
  764. -18> 2019-10-31 09:59:59.697 7f1a75364700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 184561374 in db.slow/036824.sst offset 18446744073709551615 size 18446744073709551615
  765. -17> 2019-10-31 09:59:59.753 7f1a8f3bda40 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-034878 succeeded,manifest_file_number is 34878, next_file_number is 36892, last_sequence is 1244403827, log_number is 36889,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  766.  
  767. -16> 2019-10-31 09:59:59.753 7f1a8f3bda40 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 36889
  768.  
  769. -15> 2019-10-31 09:59:59.753 7f1a8f3bda40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1572508799759786, "job": 1, "event": "recovery_started", "log_files": [36887, 36889]}
  770. -14> 2019-10-31 09:59:59.753 7f1a8f3bda40 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #36887 mode 0
  771. -13> 2019-10-31 10:00:00.413 7f1a8f3bda40 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #36889 mode 0
  772. -12> 2019-10-31 10:00:02.233 7f1a8f3bda40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1572508802239862, "job": 1, "event": "recovery_finished"}
  773. -11> 2019-10-31 10:00:02.233 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  774. -10> 2019-10-31 10:00:02.325 7f1a8f3bda40 1 get compressor snappy = 0
  775. -9> 2019-10-31 10:00:02.325 7f1a8f3bda40 1 load compressor snappy
  776. -8> 2019-10-31 10:00:02.329 7f1a8f3bda40 1 add compressor snappy 0x482a760
  777. -7> 2019-10-31 10:00:02.329 7f1a8f3bda40 1 get compressor snappy = 0x482a760
  778. -6> 2019-10-31 10:00:02.329 7f1a8f3bda40 1 load: compressor snappy loaded and registered
  779. -5> 2019-10-31 10:00:02.329 7f1a8f3bda40 1 get compressor snappy = 0x482a760
  780. -4> 2019-10-31 10:00:02.329 7f1a8f3bda40 1 freelist init
  781. -3> 2019-10-31 10:00:02.385 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _open_alloc opening allocation metadata
  782. -2> 2019-10-31 10:00:02.401 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _open_alloc loaded 0 B in 0 extents
  783. -1> 2019-10-31 10:00:02.401 7f1a8f3bda40 -1 /build/ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: In function 'void AllocatorLevel02<T>::_mark_allocated(uint64_t, uint64_t) [with L1 = AllocatorLevel01Loose; uint64_t = long unsigned int]' thread 7f1a8f3bda40 time 2019-10-31 10:00:02.403922
  784. /build/ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(available >= allocated)
  785.  
  786. ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable)
  787. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f1a8519c64e]
  788. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a8519c829]
  789. 3: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0xd2919c]
  790. 4: (BlueStore::_open_alloc()+0x445) [0xbdbc45]
  791. 5: (BlueStore::_open_db_and_around(bool)+0x146) [0xbf6c96]
  792. 6: (BlueStore::_mount(bool, bool)+0x68a) [0xc42e5a]
  793. 7: (main()+0x2f1c) [0x6ac3fc]
  794. 8: (__libc_start_main()+0xf0) [0x7f1a83f9d830]
  795. 9: (_start()+0x29) [0x6d9179]
  796.  
  797. 0> 2019-10-31 10:00:02.405 7f1a8f3bda40 -1 *** Caught signal (Aborted) **
  798. in thread 7f1a8f3bda40 thread_name:ceph-objectstor
  799.  
  800. ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable)
  801. 1: (()+0x11390) [0x7f1a84869390]
  802. 2: (gsignal()+0x38) [0x7f1a83fb2428]
  803. 3: (abort()+0x16a) [0x7f1a83fb402a]
  804. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7f1a8519c69f]
  805. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a8519c829]
  806. 6: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0xd2919c]
  807. 7: (BlueStore::_open_alloc()+0x445) [0xbdbc45]
  808. 8: (BlueStore::_open_db_and_around(bool)+0x146) [0xbf6c96]
  809. 9: (BlueStore::_mount(bool, bool)+0x68a) [0xc42e5a]
  810. 10: (main()+0x2f1c) [0x6ac3fc]
  811. 11: (__libc_start_main()+0xf0) [0x7f1a83f9d830]
  812. 12: (_start()+0x29) [0x6d9179]
  813. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  814.  
  815. --- logging levels ---
  816. 0/ 5 none
  817. 0/ 1 lockdep
  818. 0/ 1 context
  819. 1/ 1 crush
  820. 1/ 5 mds
  821. 1/ 5 mds_balancer
  822. 1/ 5 mds_locker
  823. 1/ 5 mds_log
  824. 1/ 5 mds_log_expire
  825. 1/ 5 mds_migrator
  826. 0/ 1 buffer
  827. 0/ 1 timer
  828. 0/ 1 filer
  829. 0/ 1 striper
  830. 0/ 1 objecter
  831. 0/ 5 rados
  832. 0/ 5 rbd
  833. 0/ 5 rbd_mirror
  834. 0/ 5 rbd_replay
  835. 0/ 5 journaler
  836. 0/ 5 objectcacher
  837. 0/ 5 client
  838. 1/ 5 osd
  839. 0/ 5 optracker
  840. 0/ 5 objclass
  841. 1/ 3 filestore
  842. 1/ 3 journal
  843. 0/ 0 ms
  844. 1/ 5 mon
  845. 0/10 monc
  846. 1/ 5 paxos
  847. 0/ 5 tp
  848. 1/ 5 auth
  849. 1/ 5 crypto
  850. 1/ 1 finisher
  851. 1/ 1 reserver
  852. 1/ 5 heartbeatmap
  853. 1/ 5 perfcounter
  854. 1/ 5 rgw
  855. 1/ 5 rgw_sync
  856. 1/10 civetweb
  857. 1/ 5 javaclient
  858. 1/ 5 asok
  859. 1/ 1 throttle
  860. 0/ 0 refs
  861. 1/ 5 xio
  862. 1/ 5 compressor
  863. 1/ 5 bluestore
  864. 1/ 5 bluefs
  865. 1/ 3 bdev
  866. 1/ 5 kstore
  867. 4/ 5 rocksdb
  868. 4/ 5 leveldb
  869. 4/ 5 memdb
  870. 1/ 5 kinetic
  871. 1/ 5 fuse
  872. 1/ 5 mgr
  873. 1/ 5 mgrc
  874. 1/ 5 dpdk
  875. 1/ 5 eventtrace
  876. -2/-2 (syslog threshold)
  877. 99/99 (stderr threshold)
  878. max_recent 500
  879. max_new 1000
  880. log_file
  881. --- end dump of recent events ---
  882. --- begin dump of recent events ---
  883. -384> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command assert hook 0x3236260
  884. -383> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command abort hook 0x3236260
  885. -382> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perfcounters_dump hook 0x3236260
  886. -381> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command 1 hook 0x3236260
  887. -380> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perf dump hook 0x3236260
  888. -379> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perfcounters_schema hook 0x3236260
  889. -378> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perf histogram dump hook 0x3236260
  890. -377> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command 2 hook 0x3236260
  891. -376> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perf schema hook 0x3236260
  892. -375> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perf histogram schema hook 0x3236260
  893. -374> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command perf reset hook 0x3236260
  894. -373> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config show hook 0x3236260
  895. -372> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config help hook 0x3236260
  896. -371> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config set hook 0x3236260
  897. -370> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config unset hook 0x3236260
  898. -369> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config get hook 0x3236260
  899. -368> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config diff hook 0x3236260
  900. -367> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command config diff get hook 0x3236260
  901. -366> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command log flush hook 0x3236260
  902. -365> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command log dump hook 0x3236260
  903. -364> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command log reopen hook 0x3236260
  904. -363> 2019-10-31 09:59:59.605 7f1a8f3bda40 5 asok(0x32c2000) register_command dump_mempools hook 0x3ec0068
  905. -362> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient: get_monmap_and_config
  906. -361> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient: build_initial_monmap
  907. -360> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient: monmap:
  908. epoch 0
  909. fsid ed7b2c16-b053-45e2-a1fe-bf3474f90508
  910. last_changed 2019-10-31 09:59:59.619828
  911. created 2019-10-31 09:59:59.619828
  912. min_mon_release 0 (unknown)
  913. 0: v1:192.168.6.80:6789/0 mon.noname-a-legacy
  914. 1: v1:192.168.6.81:6789/0 mon.noname-b-legacy
  915. 2: v1:192.168.6.82:6789/0 mon.noname-c-legacy
  916. 3: v2:192.168.6.80:3300/0 mon.noname-a
  917. 4: v2:192.168.6.81:3300/0 mon.noname-b
  918. 5: v2:192.168.6.82:3300/0 mon.noname-c
  919.  
  920. -359> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding auth protocol: cephx
  921. -358> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding auth protocol: cephx
  922. -357> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding auth protocol: cephx
  923. -356> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding auth protocol: none
  924. -355> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: secure
  925. -354> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: crc
  926. -353> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: secure
  927. -352> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: crc
  928. -351> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: secure
  929. -350> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: crc
  930. -349> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: crc
  931. -348> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: secure
  932. -347> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: crc
  933. -346> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: secure
  934. -345> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: crc
  935. -344> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x3402140) adding con mode: secure
  936. -343> 2019-10-31 09:59:59.613 7f1a8f3bda40 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
  937. -342> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient: init
  938. -341> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: cephx
  939. -340> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: cephx
  940. -339> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: cephx
  941. -338> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: none
  942. -337> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  943. -336> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  944. -335> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  945. -334> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  946. -333> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  947. -332> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  948. -331> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  949. -330> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  950. -329> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  951. -328> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  952. -327> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  953. -326> 2019-10-31 09:59:59.613 7f1a8f3bda40 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  954. -325> 2019-10-31 09:59:59.613 7f1a8f3bda40 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
  955. -324> 2019-10-31 09:59:59.613 7f1a8f3bda40 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
  956. -323> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient: _reopen_session rank -1
  957. -322> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): picked mon.noname-a-legacy con 0x32abf80 addr v1:192.168.6.80:6789/0
  958. -321> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): picked mon.noname-c con 0x32ac880 addr v2:192.168.6.82:3300/0
  959. -320> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): picked mon.noname-a con 0x32acd00 addr v2:192.168.6.80:3300/0
  960. -319> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): start opening mon connection
  961. -318> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): start opening mon connection
  962. -317> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): _renew_subs
  963. -316> 2019-10-31 09:59:59.613 7f1a8f3bda40 10 monclient(hunting): authenticate will time out at 2019-10-31 10:04:59.621236
  964. -315> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): get_auth_request con 0x32acd00 auth_method 0
  965. -314> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2]
  966. -313> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): _init_auth method 2
  967. -312> 2019-10-31 09:59:59.617 7f1a8037a700 10 monclient(hunting): get_auth_request con 0x32ac880 auth_method 0
  968. -311> 2019-10-31 09:59:59.617 7f1a8037a700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2]
  969. -310> 2019-10-31 09:59:59.617 7f1a8037a700 10 monclient(hunting): _init_auth method 2
  970. -309> 2019-10-31 09:59:59.617 7f1a8037a700 10 monclient(hunting): handle_auth_reply_more payload 9
  971. -308> 2019-10-31 09:59:59.617 7f1a8037a700 10 monclient(hunting): handle_auth_reply_more payload_len 9
  972. -307> 2019-10-31 09:59:59.617 7f1a8037a700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
  973. -306> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): handle_auth_reply_more payload 9
  974. -305> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): handle_auth_reply_more payload_len 9
  975. -304> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
  976. -303> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient(hunting): handle_auth_done global_id 21805929 payload 386
  977. -302> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient: _finish_hunting 0
  978. -301> 2019-10-31 09:59:59.617 7f1a8137c700 1 monclient: found mon.noname-a
  979. -300> 2019-10-31 09:59:59.617 7f1a8137c700 10 monclient: _send_mon_message to mon.noname-a at v2:192.168.6.80:3300/0
  980. -299> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: handle_monmap mon_map magic: 0 v1
  981. -298> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: got monmap 12 from mon.noname-a (according to old e12)
  982. -297> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: dump:
  983. epoch 12
  984. fsid ed7b2c16-b053-45e2-a1fe-bf3474f90508
  985. last_changed 2019-07-22 11:59:41.402816
  986. created 2016-11-26 14:08:37.372404
  987. min_mon_release 14 (nautilus)
  988. 0: [v2:192.168.6.80:3300/0,v1:192.168.6.80:6789/0] mon.ceph-mon1
  989. 1: [v2:192.168.6.81:3300/0,v1:192.168.6.81:6789/0] mon.ceph-mon2
  990. 2: [v2:192.168.6.82:3300/0,v1:192.168.6.82:6789/0] mon.ceph-mon3
  991.  
  992. -296> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: _finish_auth 0
  993. -295> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2019-10-31 09:59:29.625643)
  994. -294> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: _send_mon_message to mon.ceph-mon1 at v2:192.168.6.80:3300/0
  995. -293> 2019-10-31 09:59:59.621 7f1a8f3bda40 5 monclient: authenticate success, global_id 21805929
  996. -292> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: handle_config config(29 keys) v1
  997. -291> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: handle_monmap mon_map magic: 0 v1
  998. -290> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: got monmap 12 from mon.ceph-mon1 (according to old e12)
  999. -289> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: dump:
  1000. epoch 12
  1001. fsid ed7b2c16-b053-45e2-a1fe-bf3474f90508
  1002. last_changed 2019-07-22 11:59:41.402816
  1003. created 2016-11-26 14:08:37.372404
  1004. min_mon_release 14 (nautilus)
  1005. 0: [v2:192.168.6.80:3300/0,v1:192.168.6.80:6789/0] mon.ceph-mon1
  1006. 1: [v2:192.168.6.81:3300/0,v1:192.168.6.81:6789/0] mon.ceph-mon2
  1007. 2: [v2:192.168.6.82:3300/0,v1:192.168.6.82:6789/0] mon.ceph-mon3
  1008.  
  1009. -288> 2019-10-31 09:59:59.621 7f1a7e376700 4 set_mon_vals no callback set
  1010. -287> 2019-10-31 09:59:59.621 7f1a8f3bda40 10 monclient: get_monmap_and_config success
  1011. -286> 2019-10-31 09:59:59.621 7f1a8f3bda40 10 monclient: shutdown
  1012. -285> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals auth_client_required = cephx
  1013. -284> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals auth_cluster_required = cephx
  1014. -283> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals auth_service_required = cephx
  1015. -282> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: _finish_auth 0
  1016. -281> 2019-10-31 09:59:59.621 7f1a7fb79700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2019-10-31 09:59:29.626182)
  1017. -280> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals bluestore_block_db_path = 77309411328
  1018. -279> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals bluestore_bluefs_gift_ratio = 0.002000
  1019. -278> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals cluster_network = 192.168.7.0/24
  1020. -277> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals mds_cache_memory_limit = 4294967296
  1021. -276> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals mon_allow_pool_delete = true
  1022. -275> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals mon_max_pg_per_osd = 200
  1023. -274> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals mon_osd_cache_size = 1024
  1024. -273> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals mon_warn_on_misplaced = true
  1025. -272> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_client_op_priority = 63
  1026. -271> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_max_backfills = 1
  1027. -270> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_max_object_name_len = 256
  1028. -269> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_max_object_namespace_len = 64
  1029. -268> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_max_pg_per_osd_hard_ratio = 1.200000
  1030. -267> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_memory_target = 4831838208
  1031. -266> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_pool_default_min_size = 2
  1032. -265> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_pool_default_pg_num = 128
  1033. -264> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_pool_default_pgp_num = 128
  1034. -263> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_pool_default_size = 2
  1035. -262> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_recovery_max_active = 1
  1036. -261> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_recovery_op_priority = 1
  1037. -260> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals osd_scrub_during_recovery = true
  1038. -259> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals public_network = 192.168.6.0/24
  1039. -258> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals rbd_default_features = 1
  1040. -257> 2019-10-31 09:59:59.621 7f1a7e376700 10 set_mon_vals rocksdb_cache_size = 1073741824
  1041. -256> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding auth protocol: cephx
  1042. -255> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding auth protocol: cephx
  1043. -254> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding auth protocol: cephx
  1044. -253> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: secure
  1045. -252> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: crc
  1046. -251> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: secure
  1047. -250> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: crc
  1048. -249> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: secure
  1049. -248> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: crc
  1050. -247> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: crc
  1051. -246> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: secure
  1052. -245> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: crc
  1053. -244> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: secure
  1054. -243> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: crc
  1055. -242> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x3402140) adding con mode: secure
  1056. -241> 2019-10-31 09:59:59.621 7f1a7e376700 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
  1057. -240> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: cephx
  1058. -239> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: cephx
  1059. -238> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding auth protocol: cephx
  1060. -237> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  1061. -236> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  1062. -235> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  1063. -234> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  1064. -233> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  1065. -232> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  1066. -231> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  1067. -230> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  1068. -229> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  1069. -228> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  1070. -227> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: crc
  1071. -226> 2019-10-31 09:59:59.621 7f1a7e376700 5 AuthRegistry(0x7ffd5b442d48) adding con mode: secure
  1072. -225> 2019-10-31 09:59:59.621 7f1a7e376700 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
  1073. -224> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _mount path /var/lib/ceph/osd/ceph-22
  1074. -223> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
  1075. -222> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecc380 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
  1076. -221> 2019-10-31 09:59:59.625 7f1a8f3bda40 0 bdev(0x3ecc380 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
  1077. -220> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecc380 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1078. -219> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  1079. -218> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev create path /var/lib/ceph/osd/ceph-22/block.db type kernel
  1080. -217> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecca80 /var/lib/ceph/osd/ceph-22/block.db) open path /var/lib/ceph/osd/ceph-22/block.db
  1081. -216> 2019-10-31 09:59:59.625 7f1a8f3bda40 0 bdev(0x3ecca80 /var/lib/ceph/osd/ceph-22/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.db failed: (22) Invalid argument
  1082. -215> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecca80 /var/lib/ceph/osd/ceph-22/block.db) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1083. -214> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-22/block.db size 1 GiB
  1084. -213> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
  1085. -212> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecce00 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
  1086. -211> 2019-10-31 09:59:59.625 7f1a8f3bda40 0 bdev(0x3ecce00 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
  1087. -210> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecce00 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1088. -209> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-22/block size 5.5 TiB
  1089. -208> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev create path /var/lib/ceph/osd/ceph-22/block.wal type kernel
  1090. -207> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecd180 /var/lib/ceph/osd/ceph-22/block.wal) open path /var/lib/ceph/osd/ceph-22/block.wal
  1091. -206> 2019-10-31 09:59:59.625 7f1a8f3bda40 0 bdev(0x3ecd180 /var/lib/ceph/osd/ceph-22/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.wal failed: (22) Invalid argument
  1092. -205> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bdev(0x3ecd180 /var/lib/ceph/osd/ceph-22/block.wal) open size 603979776 (0x24000000, 576 MiB) block_size 4096 (4 KiB) non-rotational discard supported
  1093. -204> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-22/block.wal size 576 MiB
  1094. -203> 2019-10-31 09:59:59.625 7f1a8f3bda40 1 bluefs mount
  1095. -202> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option compaction_readahead_size = 2097152
  1096. -201> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option compression = kNoCompression
  1097. -200> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option max_background_compactions = 2
  1098. -199> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option max_write_buffer_number = 4
  1099. -198> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option min_write_buffer_number_to_merge = 1
  1100. -197> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option recycle_log_file_num = 4
  1101. -196> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option writable_file_max_buffer_size = 0
  1102. -195> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option write_buffer_size = 268435456
  1103. -194> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option compaction_readahead_size = 2097152
  1104. -193> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option compression = kNoCompression
  1105. -192> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option max_background_compactions = 2
  1106. -191> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option max_write_buffer_number = 4
  1107. -190> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option min_write_buffer_number_to_merge = 1
  1108. -189> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option recycle_log_file_num = 4
  1109. -188> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option writable_file_max_buffer_size = 0
  1110. -187> 2019-10-31 09:59:59.653 7f1a8f3bda40 0 set rocksdb option write_buffer_size = 268435456
  1111. -186> 2019-10-31 09:59:59.657 7f1a8f3bda40 1 rocksdb: do_open column families: [default]
  1112. -185> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: RocksDB version: 6.1.2
  1113.  
  1114. -184> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  1115. -183> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Compile date Sep 13 2019
  1116. -182> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: DB SUMMARY
  1117.  
  1118. -181> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: CURRENT file: CURRENT
  1119.  
  1120. -180> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: IDENTITY file: IDENTITY
  1121.  
  1122. -179> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: MANIFEST file: MANIFEST-034878 size: 269419 Bytes
  1123.  
  1124. -178> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: SST files in db dir, Total Num: 7, files: 036855.sst 036856.sst 036858.sst 036859.sst 036886.sst 036888.sst 036890.sst
  1125.  
  1126. -177> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: SST files in db.slow dir, Total Num: 182, files: 033490.sst 033491.sst 033632.sst 034662.sst 034717.sst 034718.sst 034719.sst 034769.sst 034770.sst
  1127.  
  1128. -176> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Write Ahead Log file in db.wal: 036887.log size: 253533899 ; 036889.log size: 255973165 ;
  1129.  
  1130. -175> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.error_if_exists: 0
  1131. -174> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.create_if_missing: 0
  1132. -173> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.paranoid_checks: 1
  1133. -172> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.env: 0x3ecaa60
  1134. -171> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.info_log: 0x3ef4f80
  1135. -170> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_file_opening_threads: 16
  1136. -169> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.statistics: (nil)
  1137. -168> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.use_fsync: 0
  1138. -167> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_log_file_size: 0
  1139. -166> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_manifest_file_size: 1073741824
  1140. -165> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.log_file_time_to_roll: 0
  1141. -164> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.keep_log_file_num: 1000
  1142. -163> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.recycle_log_file_num: 4
  1143. -162> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_fallocate: 1
  1144. -161> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_mmap_reads: 0
  1145. -160> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_mmap_writes: 0
  1146. -159> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.use_direct_reads: 0
  1147. -158> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  1148. -157> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.create_missing_column_families: 0
  1149. -156> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.db_log_dir:
  1150. -155> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.wal_dir: db.wal
  1151. -154> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.table_cache_numshardbits: 6
  1152. -153> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_subcompactions: 1
  1153. -152> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_background_flushes: -1
  1154. -151> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.WAL_ttl_seconds: 0
  1155. -150> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.WAL_size_limit_MB: 0
  1156. -149> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.manifest_preallocation_size: 4194304
  1157. -148> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.is_fd_close_on_exec: 1
  1158. -147> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.advise_random_on_open: 1
  1159. -146> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.db_write_buffer_size: 0
  1160. -145> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.write_buffer_manager: 0x3edef00
  1161. -144> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.access_hint_on_compaction_start: 1
  1162. -143> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  1163. -142> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  1164. -141> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.use_adaptive_mutex: 0
  1165. -140> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.rate_limiter: (nil)
  1166. -139> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  1167. -138> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.wal_recovery_mode: 0
  1168. -137> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.enable_thread_tracking: 0
  1169. -136> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.enable_pipelined_write: 0
  1170. -135> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  1171. -134> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  1172. -133> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.write_thread_max_yield_usec: 100
  1173. -132> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  1174. -131> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.row_cache: None
  1175. -130> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.wal_filter: None
  1176. -129> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.avoid_flush_during_recovery: 0
  1177. -128> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.allow_ingest_behind: 0
  1178. -127> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.preserve_deletes: 0
  1179. -126> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.two_write_queues: 0
  1180. -125> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.manual_wal_flush: 0
  1181. -124> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.atomic_flush: 0
  1182. -123> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  1183. -122> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_background_jobs: 2
  1184. -121> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_background_compactions: 2
  1185. -120> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  1186. -119> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.writable_file_max_buffer_size: 0
  1187. -118> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.delayed_write_rate : 16777216
  1188. -117> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_total_wal_size: 0
  1189. -116> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  1190. -115> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.stats_dump_period_sec: 600
  1191. -114> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.stats_persist_period_sec: 600
  1192. -113> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.stats_history_buffer_size: 1048576
  1193. -112> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_open_files: -1
  1194. -111> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bytes_per_sync: 0
  1195. -110> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.wal_bytes_per_sync: 0
  1196. -109> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_readahead_size: 2097152
  1197. -108> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Compression algorithms supported:
  1198. -107> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kZSTDNotFinalCompression supported: 0
  1199. -106> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kZSTD supported: 0
  1200. -105> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kXpressCompression supported: 0
  1201. -104> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kLZ4HCCompression supported: 1
  1202. -103> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kLZ4Compression supported: 1
  1203. -102> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kBZip2Compression supported: 0
  1204. -101> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kZlibCompression supported: 1
  1205. -100> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: kSnappyCompression supported: 1
  1206. -99> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Fast CRC32 supported: Supported on x86
  1207. -98> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: [db/db_impl_readonly.cc:22] Opening the db in read only mode
  1208. -97> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-034878
  1209.  
  1210. -96> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  1211.  
  1212. -95> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  1213. -94> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  1214. -93> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_filter: None
  1215. -92> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_filter_factory: None
  1216. -91> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_factory: SkipListFactory
  1217. -90> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.table_factory: BlockBasedTable
  1218. -89> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x321ef40)
  1219. cache_index_and_filter_blocks: 1
  1220. cache_index_and_filter_blocks_with_high_priority: 1
  1221. pin_l0_filter_and_index_blocks_in_cache: 1
  1222. pin_top_level_index_and_filter: 1
  1223. index_type: 0
  1224. data_block_index_type: 0
  1225. data_block_hash_table_util_ratio: 0.750000
  1226. hash_index_allow_collision: 1
  1227. checksum: 1
  1228. no_block_cache: 0
  1229. block_cache: 0x322e250
  1230. block_cache_name: BinnedLRUCache
  1231. block_cache_options:
  1232. capacity : 429496729
  1233. num_shard_bits : 4
  1234. strict_capacity_limit : 0
  1235. high_pri_pool_ratio: 0.000
  1236. block_cache_compressed: (nil)
  1237. persistent_cache: (nil)
  1238. block_size: 4096
  1239. block_size_deviation: 10
  1240. block_restart_interval: 16
  1241. index_block_restart_interval: 1
  1242. metadata_block_size: 4096
  1243. partition_filters: 0
  1244. use_delta_encoding: 1
  1245. filter_policy: rocksdb.BuiltinBloomFilter
  1246. whole_key_filtering: 1
  1247. verify_compression: 0
  1248. read_amp_bytes_per_bit: 0
  1249. format_version: 2
  1250. enable_index_compression: 1
  1251. block_align: 0
  1252.  
  1253. -88> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.write_buffer_size: 268435456
  1254. -87> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_write_buffer_number: 4
  1255. -86> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression: NoCompression
  1256. -85> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression: Disabled
  1257. -84> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.prefix_extractor: nullptr
  1258. -83> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  1259. -82> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.num_levels: 7
  1260. -81> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  1261. -80> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  1262. -79> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  1263. -78> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  1264. -77> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  1265. -76> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  1266. -75> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  1267. -74> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  1268. -73> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.window_bits: -14
  1269. -72> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.level: 32767
  1270. -71> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.strategy: 0
  1271. -70> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  1272. -69> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  1273. -68> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compression_opts.enabled: false
  1274. -67> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  1275. -66> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  1276. -65> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.level0_stop_writes_trigger: 36
  1277. -64> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.target_file_size_base: 67108864
  1278. -63> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.target_file_size_multiplier: 1
  1279. -62> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  1280. -61> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  1281. -60> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  1282. -59> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  1283. -58> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  1284. -57> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  1285. -56> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  1286. -55> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  1287. -54> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  1288. -53> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  1289. -52> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  1290. -51> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_compaction_bytes: 1677721600
  1291. -50> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.arena_block_size: 33554432
  1292. -49> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  1293. -48> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  1294. -47> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  1295. -46> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.disable_auto_compactions: 0
  1296. -45> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  1297. -44> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  1298. -43> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  1299. -42> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  1300. -41> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  1301. -40> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  1302. -39> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  1303. -38> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  1304. -37> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  1305. -36> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  1306. -35> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.table_properties_collectors:
  1307. -34> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.inplace_update_support: 0
  1308. -33> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.inplace_update_num_locks: 10000
  1309. -32> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  1310. -31> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_whole_key_filtering: 0
  1311. -30> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.memtable_huge_page_size: 0
  1312. -29> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.bloom_locality: 0
  1313. -28> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.max_successive_merges: 0
  1314. -27> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.optimize_filters_for_hits: 0
  1315. -26> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.paranoid_file_checks: 0
  1316. -25> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.force_consistency_checks: 0
  1317. -24> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.report_bg_io_stats: 0
  1318. -23> 2019-10-31 09:59:59.657 7f1a8f3bda40 4 rocksdb: Options.ttl: 0
  1319. -22> 2019-10-31 09:59:59.661 7f1a76b67700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 177636318 in db/036858.sst offset 18446744073709551615 size 18446744073709551615
  1320. -21> 2019-10-31 09:59:59.661 7f1a78b6b700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 2028823508 in db/036890.sst offset 18446744073709551615 size 18446744073709551615
  1321. -20> 2019-10-31 09:59:59.661 7f1a7836a700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 994402680 in db/036888.sst offset 18446744073709551615 size 18446744073709551615
  1322. -19> 2019-10-31 09:59:59.661 7f1a77b69700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 581611736 in db/036886.sst offset 18446744073709551615 size 18446744073709551615
  1323. -18> 2019-10-31 09:59:59.697 7f1a75364700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 184561374 in db.slow/036824.sst offset 18446744073709551615 size 18446744073709551615
  1324. -17> 2019-10-31 09:59:59.753 7f1a8f3bda40 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-034878 succeeded,manifest_file_number is 34878, next_file_number is 36892, last_sequence is 1244403827, log_number is 36889,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  1325.  
  1326. -16> 2019-10-31 09:59:59.753 7f1a8f3bda40 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 36889
  1327.  
  1328. -15> 2019-10-31 09:59:59.753 7f1a8f3bda40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1572508799759786, "job": 1, "event": "recovery_started", "log_files": [36887, 36889]}
  1329. -14> 2019-10-31 09:59:59.753 7f1a8f3bda40 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #36887 mode 0
  1330. -13> 2019-10-31 10:00:00.413 7f1a8f3bda40 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #36889 mode 0
  1331. -12> 2019-10-31 10:00:02.233 7f1a8f3bda40 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1572508802239862, "job": 1, "event": "recovery_finished"}
  1332. -11> 2019-10-31 10:00:02.233 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  1333. -10> 2019-10-31 10:00:02.325 7f1a8f3bda40 1 get compressor snappy = 0
  1334. -9> 2019-10-31 10:00:02.325 7f1a8f3bda40 1 load compressor snappy
  1335. -8> 2019-10-31 10:00:02.329 7f1a8f3bda40 1 add compressor snappy 0x482a760
  1336. -7> 2019-10-31 10:00:02.329 7f1a8f3bda40 1 get compressor snappy = 0x482a760
  1337. -6> 2019-10-31 10:00:02.329 7f1a8f3bda40 1 load: compressor snappy loaded and registered
  1338. -5> 2019-10-31 10:00:02.329 7f1a8f3bda40 1 get compressor snappy = 0x482a760
  1339. -4> 2019-10-31 10:00:02.329 7f1a8f3bda40 1 freelist init
  1340. -3> 2019-10-31 10:00:02.385 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _open_alloc opening allocation metadata
  1341. -2> 2019-10-31 10:00:02.401 7f1a8f3bda40 1 bluestore(/var/lib/ceph/osd/ceph-22) _open_alloc loaded 0 B in 0 extents
  1342. -1> 2019-10-31 10:00:02.401 7f1a8f3bda40 -1 /build/ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: In function 'void AllocatorLevel02<T>::_mark_allocated(uint64_t, uint64_t) [with L1 = AllocatorLevel01Loose; uint64_t = long unsigned int]' thread 7f1a8f3bda40 time 2019-10-31 10:00:02.403922
  1343. /build/ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(available >= allocated)
  1344.  
  1345. ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable)
  1346. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f1a8519c64e]
  1347. 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a8519c829]
  1348. 3: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0xd2919c]
  1349. 4: (BlueStore::_open_alloc()+0x445) [0xbdbc45]
  1350. 5: (BlueStore::_open_db_and_around(bool)+0x146) [0xbf6c96]
  1351. 6: (BlueStore::_mount(bool, bool)+0x68a) [0xc42e5a]
  1352. 7: (main()+0x2f1c) [0x6ac3fc]
  1353. 8: (__libc_start_main()+0xf0) [0x7f1a83f9d830]
  1354. 9: (_start()+0x29) [0x6d9179]
  1355.  
  1356. 0> 2019-10-31 10:00:02.405 7f1a8f3bda40 -1 *** Caught signal (Aborted) **
  1357. in thread 7f1a8f3bda40 thread_name:ceph-objectstor
  1358.  
  1359. ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable)
  1360. 1: (()+0x11390) [0x7f1a84869390]
  1361. 2: (gsignal()+0x38) [0x7f1a83fb2428]
  1362. 3: (abort()+0x16a) [0x7f1a83fb402a]
  1363. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7f1a8519c69f]
  1364. 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a8519c829]
  1365. 6: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0xd2919c]
  1366. 7: (BlueStore::_open_alloc()+0x445) [0xbdbc45]
  1367. 8: (BlueStore::_open_db_and_around(bool)+0x146) [0xbf6c96]
  1368. 9: (BlueStore::_mount(bool, bool)+0x68a) [0xc42e5a]
  1369. 10: (main()+0x2f1c) [0x6ac3fc]
  1370. 11: (__libc_start_main()+0xf0) [0x7f1a83f9d830]
  1371. 12: (_start()+0x29) [0x6d9179]
  1372. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  1373.  
  1374. --- logging levels ---
  1375. 0/ 5 none
  1376. 0/ 1 lockdep
  1377. 0/ 1 context
  1378. 1/ 1 crush
  1379. 1/ 5 mds
  1380. 1/ 5 mds_balancer
  1381. 1/ 5 mds_locker
  1382. 1/ 5 mds_log
  1383. 1/ 5 mds_log_expire
  1384. 1/ 5 mds_migrator
  1385. 0/ 1 buffer
  1386. 0/ 1 timer
  1387. 0/ 1 filer
  1388. 0/ 1 striper
  1389. 0/ 1 objecter
  1390. 0/ 5 rados
  1391. 0/ 5 rbd
  1392. 0/ 5 rbd_mirror
  1393. 0/ 5 rbd_replay
  1394. 0/ 5 journaler
  1395. 0/ 5 objectcacher
  1396. 0/ 5 client
  1397. 1/ 5 osd
  1398. 0/ 5 optracker
  1399. 0/ 5 objclass
  1400. 1/ 3 filestore
  1401. 1/ 3 journal
  1402. 0/ 0 ms
  1403. 1/ 5 mon
  1404. 0/10 monc
  1405. 1/ 5 paxos
  1406. 0/ 5 tp
  1407. 1/ 5 auth
  1408. 1/ 5 crypto
  1409. 1/ 1 finisher
  1410. 1/ 1 reserver
  1411. 1/ 5 heartbeatmap
  1412. 1/ 5 perfcounter
  1413. 1/ 5 rgw
  1414. 1/ 5 rgw_sync
  1415. 1/10 civetweb
  1416. 1/ 5 javaclient
  1417. 1/ 5 asok
  1418. 1/ 1 throttle
  1419. 0/ 0 refs
  1420. 1/ 5 xio
  1421. 1/ 5 compressor
  1422. 1/ 5 bluestore
  1423. 1/ 5 bluefs
  1424. 1/ 3 bdev
  1425. 1/ 5 kstore
  1426. 4/ 5 rocksdb
  1427. 4/ 5 leveldb
  1428. 4/ 5 memdb
  1429. 1/ 5 kinetic
  1430. 1/ 5 fuse
  1431. 1/ 5 mgr
  1432. 1/ 5 mgrc
  1433. 1/ 5 dpdk
  1434. 1/ 5 eventtrace
  1435. -2/-2 (syslog threshold)
  1436. 99/99 (stderr threshold)
  1437. max_recent 500
  1438. max_new 1000
  1439. log_file /var/lib/ceph/crash/2019-10-31_08:00:02.411991Z_afcdc2b3-77db-4f75-a11d-cb75427498c0/log
  1440. --- end dump of recent events ---
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!