Advertisement
Guest User

Untitled

a guest
Dec 12th, 2020
423
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 490.15 KB | None | 0 0
  1. 2020-12-12 20:23:34.136 7f9598450c80 0 set uid:gid to 64045:64045 (ceph:ceph)
  2. 2020-12-12 20:23:34.136 7f9598450c80 0 ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable), process ceph-osd, pid 797133
  3. 2020-12-12 20:23:34.136 7f9598450c80 0 pidfile_write: ignore empty --pid-file
  4. 2020-12-12 20:23:34.140 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  5. 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  6. 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  7. 2020-12-12 20:23:34.140 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  8. 2020-12-12 20:23:34.140 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  9. 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf0e00 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  10. 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf0e00 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  11. 2020-12-12 20:23:34.140 7f9598450c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  12. 2020-12-12 20:23:34.140 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  13. 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf1180 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  14. 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf1180 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  15. 2020-12-12 20:23:34.140 7f9598450c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  16. 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf0e00 /var/lib/ceph/osd/ceph-11/block.db) close
  17. 2020-12-12 20:23:34.424 7f9598450c80 1 bdev(0x55a725cf1180 /var/lib/ceph/osd/ceph-11/block) close
  18. 2020-12-12 20:23:34.680 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) close
  19. 2020-12-12 20:23:34.928 7f9598450c80 0 starting osd.11 osd_data /var/lib/ceph/osd/ceph-11 /var/lib/ceph/osd/ceph-11/journal
  20. 2020-12-12 20:23:34.944 7f9598450c80 0 load: jerasure load: lrc load: isa
  21. 2020-12-12 20:23:34.944 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  22. 2020-12-12 20:23:34.944 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  23. 2020-12-12 20:23:34.944 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  24. 2020-12-12 20:23:34.944 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  25. 2020-12-12 20:23:34.944 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) close
  26. 2020-12-12 20:23:35.236 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _mount path /var/lib/ceph/osd/ceph-11
  27. 2020-12-12 20:23:35.236 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  28. 2020-12-12 20:23:35.236 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  29. 2020-12-12 20:23:35.236 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  30. 2020-12-12 20:23:35.240 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  31. 2020-12-12 20:23:35.240 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  32. 2020-12-12 20:23:35.240 7f9598450c80 1 bdev(0x55a725cf1880 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  33. 2020-12-12 20:23:35.240 7f9598450c80 1 bdev(0x55a725cf1880 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  34. 2020-12-12 20:23:35.240 7f9598450c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  35. 2020-12-12 20:23:35.240 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  36. 2020-12-12 20:23:35.240 7f9598450c80 1 bdev(0x55a725cf1500 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  37. 2020-12-12 20:23:35.240 7f9598450c80 1 bdev(0x55a725cf1500 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  38. 2020-12-12 20:23:35.240 7f9598450c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  39. 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option compaction_readahead_size = 2097152
  40. 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option compression = kNoCompression
  41. 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option max_background_compactions = 2
  42. 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option max_write_buffer_number = 4
  43. 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  44. 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option recycle_log_file_num = 4
  45. 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option writable_file_max_buffer_size = 0
  46. 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option write_buffer_size = 268435456
  47. 2020-12-12 20:23:35.240 7f9598450c80 1 bluefs mount
  48. 2020-12-12 20:23:35.240 7f9598450c80 1 bluefs _init_alloc id 1 alloc_size 0x100000 size 0x14c8500000
  49. 2020-12-12 20:23:35.240 7f9598450c80 1 bluefs _init_alloc id 2 alloc_size 0x10000 size 0x3a381400000
  50. 2020-12-12 20:23:35.276 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db set db_paths to db,84797030400 db.slow,3800743857356
  51. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option compaction_readahead_size = 2097152
  52. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option compression = kNoCompression
  53. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option max_background_compactions = 2
  54. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option max_write_buffer_number = 4
  55. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  56. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option recycle_log_file_num = 4
  57. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option writable_file_max_buffer_size = 0
  58. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option write_buffer_size = 268435456
  59. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option compaction_readahead_size = 2097152
  60. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option compression = kNoCompression
  61. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option max_background_compactions = 2
  62. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option max_write_buffer_number = 4
  63. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  64. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option recycle_log_file_num = 4
  65. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option writable_file_max_buffer_size = 0
  66. 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option write_buffer_size = 268435456
  67. 2020-12-12 20:23:35.276 7f9598450c80 1 rocksdb: do_open column families: [default]
  68. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: RocksDB version: 6.1.2
  69.  
  70. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  71. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Compile date Dec 2 2020
  72. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: DB SUMMARY
  73.  
  74. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: CURRENT file: CURRENT
  75.  
  76. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: IDENTITY file: IDENTITY
  77.  
  78. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: MANIFEST file: MANIFEST-003616 size: 6029 Bytes
  79.  
  80. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: SST files in db dir, Total Num: 47, files: 000199.sst 000264.sst 000265.sst 000340.sst 000341.sst 000342.sst 000343.sst 000345.sst 000346.sst
  81.  
  82. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
  83.  
  84. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Write Ahead Log file in db.wal: 003617.log size: 0 ;
  85.  
  86. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.error_if_exists: 0
  87. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.create_if_missing: 0
  88. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.paranoid_checks: 1
  89. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.env: 0x55a725da2e40
  90. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.info_log: 0x55a725da3860
  91. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_file_opening_threads: 16
  92. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.statistics: (nil)
  93. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.use_fsync: 0
  94. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_log_file_size: 0
  95. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
  96. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.log_file_time_to_roll: 0
  97. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.keep_log_file_num: 1000
  98. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.recycle_log_file_num: 4
  99. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.allow_fallocate: 1
  100. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.allow_mmap_reads: 0
  101. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.allow_mmap_writes: 0
  102. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.use_direct_reads: 0
  103. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  104. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.create_missing_column_families: 0
  105. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.db_log_dir:
  106. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.wal_dir: db.wal
  107. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.table_cache_numshardbits: 6
  108. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_subcompactions: 1
  109. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_background_flushes: -1
  110. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.WAL_ttl_seconds: 0
  111. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.WAL_size_limit_MB: 0
  112. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
  113. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.is_fd_close_on_exec: 1
  114. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.advise_random_on_open: 1
  115. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.db_write_buffer_size: 0
  116. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.write_buffer_manager: 0x55a725df7080
  117. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
  118. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  119. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  120. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.use_adaptive_mutex: 0
  121. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.rate_limiter: (nil)
  122. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  123. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.wal_recovery_mode: 0
  124. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.enable_thread_tracking: 0
  125. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.enable_pipelined_write: 0
  126. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  127. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  128. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
  129. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  130. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.row_cache: None
  131. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.wal_filter: None
  132. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
  133. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.allow_ingest_behind: 0
  134. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.preserve_deletes: 0
  135. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.two_write_queues: 0
  136. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.manual_wal_flush: 0
  137. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.atomic_flush: 0
  138. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  139. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_background_jobs: 2
  140. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_background_compactions: 2
  141. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  142. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.writable_file_max_buffer_size: 0
  143. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.delayed_write_rate : 16777216
  144. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_total_wal_size: 0
  145. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  146. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.stats_dump_period_sec: 600
  147. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.stats_persist_period_sec: 600
  148. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
  149. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_open_files: -1
  150. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bytes_per_sync: 0
  151. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.wal_bytes_per_sync: 0
  152. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_readahead_size: 2097152
  153. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Compression algorithms supported:
  154. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
  155. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kZSTD supported: 0
  156. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kXpressCompression supported: 0
  157. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kLZ4HCCompression supported: 1
  158. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kLZ4Compression supported: 1
  159. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kBZip2Compression supported: 0
  160. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kZlibCompression supported: 1
  161. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kSnappyCompression supported: 1
  162. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Fast CRC32 supported: Supported on x86
  163. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: [db/db_impl_readonly.cc:22] Opening the db in read only mode
  164. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-003616
  165.  
  166. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  167.  
  168. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  169. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  170. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_filter: None
  171. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_filter_factory: None
  172. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.memtable_factory: SkipListFactory
  173. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.table_factory: BlockBasedTable
  174. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a725019360)
  175. cache_index_and_filter_blocks: 1
  176. cache_index_and_filter_blocks_with_high_priority: 1
  177. pin_l0_filter_and_index_blocks_in_cache: 0
  178. pin_top_level_index_and_filter: 1
  179. index_type: 0
  180. data_block_index_type: 0
  181. data_block_hash_table_util_ratio: 0.750000
  182. hash_index_allow_collision: 1
  183. checksum: 1
  184. no_block_cache: 0
  185. block_cache: 0x55a725062a10
  186. block_cache_name: BinnedLRUCache
  187. block_cache_options:
  188. capacity : 429496729
  189. num_shard_bits : 4
  190. strict_capacity_limit : 0
  191. high_pri_pool_ratio: 0.000
  192. block_cache_compressed: (nil)
  193. persistent_cache: (nil)
  194. block_size: 4096
  195. block_size_deviation: 10
  196. block_restart_interval: 16
  197. index_block_restart_interval: 1
  198. metadata_block_size: 4096
  199. partition_filters: 0
  200. use_delta_encoding: 1
  201. filter_policy: rocksdb.BuiltinBloomFilter
  202. whole_key_filtering: 1
  203. verify_compression: 0
  204. read_amp_bytes_per_bit: 0
  205. format_version: 2
  206. enable_index_compression: 1
  207. block_align: 0
  208.  
  209. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.write_buffer_size: 268435456
  210. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_write_buffer_number: 4
  211. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression: NoCompression
  212. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression: Disabled
  213. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.prefix_extractor: nullptr
  214. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  215. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.num_levels: 7
  216. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  217. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  218. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  219. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  220. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  221. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  222. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  223. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  224. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression_opts.window_bits: -14
  225. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression_opts.level: 32767
  226. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression_opts.strategy: 0
  227. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  228. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  229. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression_opts.enabled: false
  230. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  231. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  232. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
  233. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.target_file_size_base: 67108864
  234. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.target_file_size_multiplier: 1
  235. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  236. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  237. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  238. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  239. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  240. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  241. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  242. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  243. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  244. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  245. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  246. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
  247. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.arena_block_size: 33554432
  248. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  249. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  250. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  251. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.disable_auto_compactions: 0
  252. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  253. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  254. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  255. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  256. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  257. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  258. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  259. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  260. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  261. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  262. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.table_properties_collectors:
  263. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.inplace_update_support: 0
  264. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.inplace_update_num_locks: 10000
  265. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  266. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
  267. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.memtable_huge_page_size: 0
  268. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bloom_locality: 0
  269. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_successive_merges: 0
  270. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.optimize_filters_for_hits: 0
  271. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.paranoid_file_checks: 0
  272. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.force_consistency_checks: 0
  273. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.report_bg_io_stats: 0
  274. 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.ttl: 0
  275. 2020-12-12 20:23:35.280 7f9598450c80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-003616 succeeded,manifest_file_number is 3616, next_file_number is 3618, last_sequence is 22382894, log_number is 3615,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  276.  
  277. 2020-12-12 20:23:35.280 7f9598450c80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 3615
  278.  
  279. 2020-12-12 20:23:35.280 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015284920, "job": 1, "event": "recovery_started", "log_files": [3617]}
  280. 2020-12-12 20:23:35.280 7f9598450c80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3617 mode 0
  281. 2020-12-12 20:23:35.280 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015284940, "job": 1, "event": "recovery_finished"}
  282. 2020-12-12 20:23:35.280 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  283. 2020-12-12 20:23:35.288 7f9598450c80 1 freelist init
  284. 2020-12-12 20:23:35.292 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_alloc opening allocation metadata
  285. 2020-12-12 20:23:35.440 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_alloc loaded 2.3 TiB in 139875 extents available 2.2 TiB
  286. 2020-12-12 20:23:35.440 7f9598450c80 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work
  287. 2020-12-12 20:23:35.440 7f9598450c80 4 rocksdb: [db/db_impl.cc:563] Shutdown complete
  288. 2020-12-12 20:23:35.440 7f9598450c80 1 bluefs umount
  289. 2020-12-12 20:23:35.440 7f9598450c80 1 bdev(0x55a725cf1880 /var/lib/ceph/osd/ceph-11/block.db) close
  290. 2020-12-12 20:23:35.520 7f9598450c80 1 bdev(0x55a725cf1500 /var/lib/ceph/osd/ceph-11/block) close
  291. 2020-12-12 20:23:35.788 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  292. 2020-12-12 20:23:35.788 7f9598450c80 1 bdev(0x55a725cf1500 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  293. 2020-12-12 20:23:35.788 7f9598450c80 1 bdev(0x55a725cf1500 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  294. 2020-12-12 20:23:35.788 7f9598450c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  295. 2020-12-12 20:23:35.788 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  296. 2020-12-12 20:23:35.788 7f9598450c80 1 bdev(0x55a725cf1880 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  297. 2020-12-12 20:23:35.788 7f9598450c80 1 bdev(0x55a725cf1880 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  298. 2020-12-12 20:23:35.788 7f9598450c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  299. 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option compaction_readahead_size = 2097152
  300. 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option compression = kNoCompression
  301. 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option max_background_compactions = 2
  302. 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option max_write_buffer_number = 4
  303. 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  304. 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option recycle_log_file_num = 4
  305. 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option writable_file_max_buffer_size = 0
  306. 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option write_buffer_size = 268435456
  307. 2020-12-12 20:23:35.788 7f9598450c80 1 bluefs mount
  308. 2020-12-12 20:23:35.788 7f9598450c80 1 bluefs _init_alloc id 1 alloc_size 0x100000 size 0x14c8500000
  309. 2020-12-12 20:23:35.788 7f9598450c80 1 bluefs _init_alloc id 2 alloc_size 0x10000 size 0x3a381400000
  310. 2020-12-12 20:23:35.820 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db set db_paths to db,84797030400 db.slow,3800743857356
  311. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option compaction_readahead_size = 2097152
  312. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option compression = kNoCompression
  313. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option max_background_compactions = 2
  314. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option max_write_buffer_number = 4
  315. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  316. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option recycle_log_file_num = 4
  317. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option writable_file_max_buffer_size = 0
  318. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option write_buffer_size = 268435456
  319. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option compaction_readahead_size = 2097152
  320. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option compression = kNoCompression
  321. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option max_background_compactions = 2
  322. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option max_write_buffer_number = 4
  323. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  324. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option recycle_log_file_num = 4
  325. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option writable_file_max_buffer_size = 0
  326. 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option write_buffer_size = 268435456
  327. 2020-12-12 20:23:35.820 7f9598450c80 1 rocksdb: do_open column families: [default]
  328. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: RocksDB version: 6.1.2
  329.  
  330. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  331. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Compile date Dec 2 2020
  332. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: DB SUMMARY
  333.  
  334. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: CURRENT file: CURRENT
  335.  
  336. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: IDENTITY file: IDENTITY
  337.  
  338. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: MANIFEST file: MANIFEST-003616 size: 6029 Bytes
  339.  
  340. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: SST files in db dir, Total Num: 47, files: 000199.sst 000264.sst 000265.sst 000340.sst 000341.sst 000342.sst 000343.sst 000345.sst 000346.sst
  341.  
  342. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
  343.  
  344. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Write Ahead Log file in db.wal: 003617.log size: 0 ;
  345.  
  346. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.error_if_exists: 0
  347. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.create_if_missing: 0
  348. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.paranoid_checks: 1
  349. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.env: 0x55a7264c4e00
  350. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.info_log: 0x55a72679b980
  351. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.max_file_opening_threads: 16
  352. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.statistics: (nil)
  353. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.use_fsync: 0
  354. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.max_log_file_size: 0
  355. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
  356. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.log_file_time_to_roll: 0
  357. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.keep_log_file_num: 1000
  358. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.recycle_log_file_num: 4
  359. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.allow_fallocate: 1
  360. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.allow_mmap_reads: 0
  361. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.allow_mmap_writes: 0
  362. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.use_direct_reads: 0
  363. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  364. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.create_missing_column_families: 0
  365. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.db_log_dir:
  366. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.wal_dir: db.wal
  367. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.table_cache_numshardbits: 6
  368. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.max_subcompactions: 1
  369. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.max_background_flushes: -1
  370. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.WAL_ttl_seconds: 0
  371. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.WAL_size_limit_MB: 0
  372. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
  373. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.is_fd_close_on_exec: 1
  374. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.advise_random_on_open: 1
  375. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.db_write_buffer_size: 0
  376. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.write_buffer_manager: 0x55a726030a50
  377. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
  378. 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  379. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  380. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.use_adaptive_mutex: 0
  381. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.rate_limiter: (nil)
  382. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  383. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.wal_recovery_mode: 0
  384. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.enable_thread_tracking: 0
  385. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.enable_pipelined_write: 0
  386. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  387. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  388. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
  389. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  390. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.row_cache: None
  391. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.wal_filter: None
  392. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
  393. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.allow_ingest_behind: 0
  394. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.preserve_deletes: 0
  395. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.two_write_queues: 0
  396. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.manual_wal_flush: 0
  397. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.atomic_flush: 0
  398. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  399. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_background_jobs: 2
  400. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_background_compactions: 2
  401. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  402. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.writable_file_max_buffer_size: 0
  403. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.delayed_write_rate : 16777216
  404. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_total_wal_size: 0
  405. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  406. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.stats_dump_period_sec: 600
  407. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.stats_persist_period_sec: 600
  408. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
  409. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_open_files: -1
  410. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bytes_per_sync: 0
  411. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.wal_bytes_per_sync: 0
  412. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_readahead_size: 2097152
  413. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Compression algorithms supported:
  414. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
  415. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kZSTD supported: 0
  416. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kXpressCompression supported: 0
  417. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kLZ4HCCompression supported: 1
  418. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kLZ4Compression supported: 1
  419. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kBZip2Compression supported: 0
  420. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kZlibCompression supported: 1
  421. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kSnappyCompression supported: 1
  422. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Fast CRC32 supported: Supported on x86
  423. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-003616
  424.  
  425. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  426.  
  427. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  428. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  429. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_filter: None
  430. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_filter_factory: None
  431. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.memtable_factory: SkipListFactory
  432. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.table_factory: BlockBasedTable
  433. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a725114258)
  434. cache_index_and_filter_blocks: 1
  435. cache_index_and_filter_blocks_with_high_priority: 1
  436. pin_l0_filter_and_index_blocks_in_cache: 0
  437. pin_top_level_index_and_filter: 1
  438. index_type: 0
  439. data_block_index_type: 0
  440. data_block_hash_table_util_ratio: 0.750000
  441. hash_index_allow_collision: 1
  442. checksum: 1
  443. no_block_cache: 0
  444. block_cache: 0x55a725062910
  445. block_cache_name: BinnedLRUCache
  446. block_cache_options:
  447. capacity : 429496729
  448. num_shard_bits : 4
  449. strict_capacity_limit : 0
  450. high_pri_pool_ratio: 0.000
  451. block_cache_compressed: (nil)
  452. persistent_cache: (nil)
  453. block_size: 4096
  454. block_size_deviation: 10
  455. block_restart_interval: 16
  456. index_block_restart_interval: 1
  457. metadata_block_size: 4096
  458. partition_filters: 0
  459. use_delta_encoding: 1
  460. filter_policy: rocksdb.BuiltinBloomFilter
  461. whole_key_filtering: 1
  462. verify_compression: 0
  463. read_amp_bytes_per_bit: 0
  464. format_version: 2
  465. enable_index_compression: 1
  466. block_align: 0
  467.  
  468. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.write_buffer_size: 268435456
  469. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_write_buffer_number: 4
  470. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression: NoCompression
  471. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression: Disabled
  472. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.prefix_extractor: nullptr
  473. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  474. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.num_levels: 7
  475. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  476. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  477. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  478. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  479. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  480. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  481. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  482. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  483. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression_opts.window_bits: -14
  484. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression_opts.level: 32767
  485. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression_opts.strategy: 0
  486. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  487. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  488. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression_opts.enabled: false
  489. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  490. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  491. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
  492. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.target_file_size_base: 67108864
  493. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.target_file_size_multiplier: 1
  494. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  495. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  496. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  497. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  498. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  499. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  500. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  501. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  502. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  503. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  504. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  505. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
  506. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.arena_block_size: 33554432
  507. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  508. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  509. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  510. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.disable_auto_compactions: 0
  511. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  512. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  513. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  514. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  515. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  516. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  517. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  518. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  519. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  520. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  521. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.table_properties_collectors:
  522. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.inplace_update_support: 0
  523. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.inplace_update_num_locks: 10000
  524. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  525. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
  526. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.memtable_huge_page_size: 0
  527. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bloom_locality: 0
  528. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_successive_merges: 0
  529. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.optimize_filters_for_hits: 0
  530. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.paranoid_file_checks: 0
  531. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.force_consistency_checks: 0
  532. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.report_bg_io_stats: 0
  533. 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.ttl: 0
  534. 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-003616 succeeded,manifest_file_number is 3616, next_file_number is 3618, last_sequence is 22382894, log_number is 3615,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  535.  
  536. 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 3615
  537.  
  538. 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015830430, "job": 1, "event": "recovery_started", "log_files": [3617]}
  539. 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3617 mode 0
  540. 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: [db/version_set.cc:3036] Creating manifest 3619
  541.  
  542. 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015832702, "job": 1, "event": "recovery_finished"}
  543. 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015832821, "job": 2, "event": "table_file_deletion", "file_number": 3623}
  544. 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015832838, "job": 2, "event": "table_file_deletion", "file_number": 3622}
  545. 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015832844, "job": 2, "event": "table_file_deletion", "file_number": 3621}
  546. 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015832850, "job": 2, "event": "table_file_deletion", "file_number": 3620}
  547. 2020-12-12 20:23:35.832 7f9598450c80 4 rocksdb: DB pointer 0x55a726324000
  548. 2020-12-12 20:23:35.832 7f958d972700 4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 3] Compacting 1@1 + 4@2 files to L2, score 1.03
  549. 2020-12-12 20:23:35.832 7f958d972700 4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 2 Base level 1, inputs: [449(64MB)], [345(64MB) 346(64MB) 347(64MB) 348(64MB)]
  550.  
  551. 2020-12-12 20:23:35.832 7f958d972700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015835357, "job": 3, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [449], "files_L2": [345, 346, 347, 348], "score": 1.02872, "input_data_size": 338693918}
  552. 2020-12-12 20:23:35.832 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  553. 2020-12-12 20:23:35.832 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _upgrade_super from 2, latest 2
  554. 2020-12-12 20:23:35.832 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _upgrade_super done
  555. 2020-12-12 20:23:35.832 7f9584960700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS -------
  556. 2020-12-12 20:23:35.832 7f9584960700 4 rocksdb: [db/db_impl.cc:778]
  557. ** DB Stats **
  558. Uptime(secs): 0.0 total, 0.0 interval
  559. Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
  560. Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
  561. Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
  562. Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
  563. Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
  564. Interval stall: 00:00:0.000 H:M:S, 0.0 percent
  565.  
  566. ** Compaction Stats [default] **
  567. Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  568. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  569. L0 2/0 3.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  570. L1 4/1 194.65 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  571. L2 37/4 2.22 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  572. Sum 43/5 2.41 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  573. Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  574.  
  575. ** Compaction Stats [default] **
  576. Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  577. -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  578. Uptime(secs): 0.0 total, 0.0 interval
  579. Flush(GB): cumulative 0.000, interval 0.000
  580. AddFile(GB): cumulative 0.000, interval 0.000
  581. AddFile(Total Files): cumulative 0, interval 0
  582. AddFile(L0 Files): cumulative 0, interval 0
  583. AddFile(Keys): cumulative 0, interval 0
  584. Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  585. Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  586. Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
  587.  
  588. ** File Read Latency Histogram By Level [default] **
  589.  
  590. ** Compaction Stats [default] **
  591. Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  592. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  593. L0 2/0 3.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  594. L1 4/1 194.65 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  595. L2 37/4 2.22 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  596. Sum 43/5 2.41 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  597. Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  598.  
  599. ** Compaction Stats [default] **
  600. Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  601. -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  602. Uptime(secs): 0.0 total, 0.0 interval
  603. Flush(GB): cumulative 0.000, interval 0.000
  604. AddFile(GB): cumulative 0.000, interval 0.000
  605. AddFile(Total Files): cumulative 0, interval 0
  606. AddFile(L0 Files): cumulative 0, interval 0
  607. AddFile(Keys): cumulative 0, interval 0
  608. Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  609. Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  610. Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
  611.  
  612. ** File Read Latency Histogram By Level [default] **
  613.  
  614. 2020-12-12 20:23:35.896 7f9598450c80 0 _get_class not permitted to load sdk
  615. 2020-12-12 20:23:35.896 7f9598450c80 0 <cls> /build/ceph/ceph-14.2.15/src/cls/hello/cls_hello.cc:296: loading cls_hello
  616. 2020-12-12 20:23:35.896 7f9598450c80 0 _get_class not permitted to load lua
  617. 2020-12-12 20:23:35.900 7f9598450c80 0 _get_class not permitted to load kvs
  618. 2020-12-12 20:23:35.900 7f9598450c80 0 <cls> /build/ceph/ceph-14.2.15/src/cls/cephfs/cls_cephfs.cc:197: loading cephfs
  619. 2020-12-12 20:23:35.900 7f9598450c80 0 osd.11 120674 crush map has features 432629308056666112, adjusting msgr requires for clients
  620. 2020-12-12 20:23:35.900 7f9598450c80 0 osd.11 120674 crush map has features 432629308056666112 was 8705, adjusting msgr requires for mons
  621. 2020-12-12 20:23:35.900 7f9598450c80 0 osd.11 120674 crush map has features 3314933069573799936, adjusting msgr requires for osds
  622. 2020-12-12 20:23:36.240 7f958d972700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3623: 42754 keys, 67717992 bytes
  623. 2020-12-12 20:23:36.240 7f958d972700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837016242727, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3623, "file_size": 67717992, "table_properties": {"data_size": 67112720, "index_size": 497464, "filter_size": 106949, "raw_key_size": 2795150, "raw_average_key_size": 65, "raw_value_size": 64371790, "raw_average_value_size": 1505, "num_data_blocks": 14079, "num_entries": 42754, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  624. 2020-12-12 20:23:36.644 7f958d972700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3624: 43658 keys, 67732235 bytes
  625. 2020-12-12 20:23:36.644 7f958d972700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837016648741, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3624, "file_size": 67732235, "table_properties": {"data_size": 67111811, "index_size": 510312, "filter_size": 109253, "raw_key_size": 3756526, "raw_average_key_size": 86, "raw_value_size": 63462002, "raw_average_value_size": 1453, "num_data_blocks": 14230, "num_entries": 43658, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  626. 2020-12-12 20:23:37.036 7f958d972700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3625: 43657 keys, 67729297 bytes
  627. 2020-12-12 20:23:37.036 7f958d972700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837017040542, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3625, "file_size": 67729297, "table_properties": {"data_size": 67113092, "index_size": 506093, "filter_size": 109253, "raw_key_size": 3372528, "raw_average_key_size": 77, "raw_value_size": 63853503, "raw_average_value_size": 1462, "num_data_blocks": 14172, "num_entries": 43657, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  628. 2020-12-12 20:23:37.424 7f958d972700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3626: 42522 keys, 67713983 bytes
  629. 2020-12-12 20:23:37.424 7f958d972700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837017427259, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3626, "file_size": 67713983, "table_properties": {"data_size": 67112021, "index_size": 494666, "filter_size": 106437, "raw_key_size": 2680741, "raw_average_key_size": 63, "raw_value_size": 64464845, "raw_average_value_size": 1516, "num_data_blocks": 14067, "num_entries": 42522, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  630. 2020-12-12 20:23:37.604 7f9598450c80 0 osd.11 120674 load_pgs
  631. 2020-12-12 20:23:37.696 7f958d972700 3 rocksdb: [db/db_impl_compaction_flush.cc:2660] Compaction error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704
  632. 2020-12-12 20:23:37.696 7f958d972700 4 rocksdb: (Original Log Time 2020/12/12-20:23:37.699824) [db/compaction_job.cc:768] [default] compacted to: files[2 4 37 0 0 0 0] max score 0.79, MB/sec: 181.7 rd, 145.3 wr, level 2, files in(1, 4) out(5) MB in(64.7, 258.3) out(258.3), read-write-amplify(9.0) write-amplify(4.0) Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704, records in: 243696, records dropped: 28515 output_compression: NoCompression
  633.  
  634. 2020-12-12 20:23:37.696 7f958d972700 4 rocksdb: (Original Log Time 2020/12/12-20:23:37.699887) EVENT_LOG_v1 {"time_micros": 1607837017699858, "job": 3, "event": "compaction_finished", "compaction_time_micros": 1864418, "compaction_time_cpu_micros": 461426, "output_level": 2, "num_output_files": 5, "total_output_size": 318240797, "num_input_records": 231169, "num_output_records": 202654, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [2, 4, 37, 0, 0, 0, 0]}
  635. 2020-12-12 20:23:37.696 7f958d972700 2 rocksdb: [db/db_impl_compaction_flush.cc:2212] Waiting after background compaction error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704, Accumulated background error counts: 1
  636. 2020-12-12 20:23:37.788 7f958b96e700 -1 rocksdb: submit_common error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704 code = 2 Rocksdb transaction:
  637. Put( Prefix = P key = 0x000000000000146e'.can_rollback_to' Value size = 12)
  638. Put( Prefix = P key = 0x000000000000146e'.rollback_info_trimmed_to' Value size = 12)
  639. Put( Prefix = O key = 0x828000000000000013f000000021213dfffffffffffffffeffffffffffffffff'o' Value size = 29)
  640. Put( Prefix = S key = 'nid_max' Value size = 8)
  641. Put( Prefix = S key = 'blobid_max' Value size = 8)
  642. 2020-12-12 20:23:37.788 7f958b96e700 -1 /build/ceph/ceph-14.2.15/src/os/bluestore/BlueStore.cc: In function 'void BlueStore::_kv_sync_thread()' thread 7f958b96e700 time 2020-12-12 20:23:37.789990
  643. /build/ceph/ceph-14.2.15/src/os/bluestore/BlueStore.cc: 11380: FAILED ceph_assert(r == 0)
  644.  
  645. ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable)
  646. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x55a719568c1e]
  647. 2: (()+0x513df6) [0x55a719568df6]
  648. 3: (BlueStore::_kv_sync_thread()+0x1826) [0x55a719b01766]
  649. 4: (BlueStore::KVSyncThread::entry()+0xd) [0x55a719b279bd]
  650. 5: (()+0x7fa3) [0x7f9598e94fa3]
  651. 6: (clone()+0x3f) [0x7f9598a444cf]
  652.  
  653. 2020-12-12 20:23:37.788 7f958b96e700 -1 *** Caught signal (Aborted) **
  654. in thread 7f958b96e700 thread_name:bstore_kv_sync
  655.  
  656. ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable)
  657. 1: (()+0x12730) [0x7f9598e9f730]
  658. 2: (gsignal()+0x10b) [0x7f95989827bb]
  659. 3: (abort()+0x121) [0x7f959896d535]
  660. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x55a719568c6f]
  661. 5: (()+0x513df6) [0x55a719568df6]
  662. 6: (BlueStore::_kv_sync_thread()+0x1826) [0x55a719b01766]
  663. 7: (BlueStore::KVSyncThread::entry()+0xd) [0x55a719b279bd]
  664. 8: (()+0x7fa3) [0x7f9598e94fa3]
  665. 9: (clone()+0x3f) [0x7f9598a444cf]
  666. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  667.  
  668. --- begin dump of recent events ---
  669. -784> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command assert hook 0x55a72501a110
  670. -783> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command abort hook 0x55a72501a110
  671. -782> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command perfcounters_dump hook 0x55a72501a110
  672. -781> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command 1 hook 0x55a72501a110
  673. -780> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command perf dump hook 0x55a72501a110
  674. -779> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command perfcounters_schema hook 0x55a72501a110
  675. -778> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command perf histogram dump hook 0x55a72501a110
  676. -777> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command 2 hook 0x55a72501a110
  677. -776> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command perf schema hook 0x55a72501a110
  678. -775> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command perf histogram schema hook 0x55a72501a110
  679. -774> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command perf reset hook 0x55a72501a110
  680. -773> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command config show hook 0x55a72501a110
  681. -772> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command config help hook 0x55a72501a110
  682. -771> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command config set hook 0x55a72501a110
  683. -770> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command config unset hook 0x55a72501a110
  684. -769> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command config get hook 0x55a72501a110
  685. -768> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command config diff hook 0x55a72501a110
  686. -767> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command config diff get hook 0x55a72501a110
  687. -766> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command log flush hook 0x55a72501a110
  688. -765> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command log dump hook 0x55a72501a110
  689. -764> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command log reopen hook 0x55a72501a110
  690. -763> 2020-12-12 20:23:34.128 7f9598450c80 5 asok(0x55a7250b8000) register_command dump_mempools hook 0x55a725cb6068
  691. -762> 2020-12-12 20:23:34.132 7f9598450c80 10 monclient: get_monmap_and_config
  692. -761> 2020-12-12 20:23:34.132 7f9598450c80 10 monclient: build_initial_monmap
  693. -760> 2020-12-12 20:23:34.132 7f9598450c80 10 monclient: monmap:
  694. epoch 0
  695. fsid d0b4c175-02ba-4a64-8040-eb163002cba6
  696. last_changed 2020-12-12 20:23:34.136402
  697. created 2020-12-12 20:23:34.136402
  698. min_mon_release 0 (unknown)
  699. 0: v1:192.168.8.100:6789/0 mon.noname-a-legacy
  700. 1: v1:192.168.8.101:6789/0 mon.noname-c-legacy
  701. 2: v1:192.168.8.102:6789/0 mon.noname-b-legacy
  702. 3: v2:192.168.8.100:3300/0 mon.noname-a
  703. 4: v2:192.168.8.101:3300/0 mon.noname-c
  704. 5: v2:192.168.8.102:3300/0 mon.noname-b
  705.  
  706. -759> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding auth protocol: cephx
  707. -758> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding auth protocol: cephx
  708. -757> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding auth protocol: cephx
  709. -756> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding con mode: secure
  710. -755> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding con mode: crc
  711. -754> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding con mode: secure
  712. -753> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding con mode: crc
  713. -752> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding con mode: secure
  714. -751> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding con mode: crc
  715. -750> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding con mode: crc
  716. -749> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding con mode: secure
  717. -748> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding con mode: crc
  718. -747> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding con mode: secure
  719. -746> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding con mode: crc
  720. -745> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x55a725c94140) adding con mode: secure
  721. -744> 2020-12-12 20:23:34.132 7f9598450c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  722. -743> 2020-12-12 20:23:34.132 7f9598450c80 10 monclient: init
  723. -742> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding auth protocol: cephx
  724. -741> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding auth protocol: cephx
  725. -740> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding auth protocol: cephx
  726. -739> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding con mode: secure
  727. -738> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding con mode: crc
  728. -737> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding con mode: secure
  729. -736> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding con mode: crc
  730. -735> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding con mode: secure
  731. -734> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding con mode: crc
  732. -733> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding con mode: crc
  733. -732> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding con mode: secure
  734. -731> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding con mode: crc
  735. -730> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding con mode: secure
  736. -729> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding con mode: crc
  737. -728> 2020-12-12 20:23:34.132 7f9598450c80 5 AuthRegistry(0x7ffd19ed0388) adding con mode: secure
  738. -727> 2020-12-12 20:23:34.132 7f9598450c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  739. -726> 2020-12-12 20:23:34.132 7f9598450c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  740. -725> 2020-12-12 20:23:34.132 7f9598450c80 10 monclient: _reopen_session rank -1
  741. -724> 2020-12-12 20:23:34.132 7f9598450c80 10 monclient(hunting): picked mon.noname-a-legacy con 0x55a7250b1b00 addr v1:192.168.8.100:6789/0
  742. -723> 2020-12-12 20:23:34.132 7f9598450c80 10 monclient(hunting): picked mon.noname-b-legacy con 0x55a7250b1f80 addr v1:192.168.8.102:6789/0
  743. -722> 2020-12-12 20:23:34.132 7f9598450c80 10 monclient(hunting): picked mon.noname-c-legacy con 0x55a7250b2400 addr v1:192.168.8.101:6789/0
  744. -721> 2020-12-12 20:23:34.132 7f9598450c80 10 monclient(hunting): _renew_subs
  745. -720> 2020-12-12 20:23:34.132 7f9598450c80 10 monclient(hunting): authenticate will time out at 2020-12-12 20:28:34.137356
  746. -719> 2020-12-12 20:23:34.132 7f9596a14700 10 monclient(hunting): _init_auth method 2
  747. -718> 2020-12-12 20:23:34.132 7f9596a14700 10 monclient(hunting): my global_id is 93709081
  748. -717> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: _finish_hunting 0
  749. -716> 2020-12-12 20:23:34.136 7f9596a14700 1 monclient: found mon.noname-b-legacy
  750. -715> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:192.168.8.102:6789/0
  751. -714> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: _finish_auth 0
  752. -713> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2020-12-12 20:23:04.138117)
  753. -712> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: _send_mon_message to mon.noname-b-legacy at v1:192.168.8.102:6789/0
  754. -711> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: handle_monmap mon_map magic: 0 v1
  755. -710> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: got monmap 11 from mon.noname-b-legacy (according to old e11)
  756. -709> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: dump:
  757. epoch 11
  758. fsid d0b4c175-02ba-4a64-8040-eb163002cba6
  759. last_changed 2020-12-05 09:42:18.637201
  760. created 2020-04-05 17:40:47.148501
  761. min_mon_release 14 (nautilus)
  762. 0: [v2:192.168.8.100:3300/0,v1:192.168.8.100:6789/0] mon.sumib
  763. 1: [v2:192.168.8.102:3300/0,v1:192.168.8.102:6789/0] mon.tower1
  764. 2: [v2:192.168.8.101:3300/0,v1:192.168.8.101:6789/0] mon.sumia
  765.  
  766. -708> 2020-12-12 20:23:34.136 7f9596a14700 1 monclient: mon.1 has (v2) addrs [v2:192.168.8.102:3300/0,v1:192.168.8.102:6789/0] but i'm connected to v1:192.168.8.102:6789/0, reconnecting
  767. -707> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: _reopen_session rank -1
  768. -706> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient(hunting): picked mon.tower1 con 0x55a7250b2880 addr [v2:192.168.8.102:3300/0,v1:192.168.8.102:6789/0]
  769. -705> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient(hunting): picked mon.sumib con 0x55a7250b2d00 addr [v2:192.168.8.100:3300/0,v1:192.168.8.100:6789/0]
  770. -704> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient(hunting): picked mon.sumia con 0x55a7250b3180 addr [v2:192.168.8.101:3300/0,v1:192.168.8.101:6789/0]
  771. -703> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient(hunting): start opening mon connection
  772. -702> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient(hunting): start opening mon connection
  773. -701> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient(hunting): start opening mon connection
  774. -700> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient(hunting): _renew_subs
  775. -699> 2020-12-12 20:23:34.136 7f9597a16700 10 monclient(hunting): get_auth_request con 0x55a7250b2880 auth_method 0
  776. -698> 2020-12-12 20:23:34.136 7f9597a16700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2]
  777. -697> 2020-12-12 20:23:34.136 7f9597a16700 10 monclient(hunting): _init_auth method 2
  778. -696> 2020-12-12 20:23:34.136 7f9597a16700 10 monclient(hunting): handle_auth_reply_more payload 9
  779. -695> 2020-12-12 20:23:34.136 7f9597a16700 10 monclient(hunting): handle_auth_reply_more payload_len 9
  780. -694> 2020-12-12 20:23:34.136 7f9597a16700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
  781. -693> 2020-12-12 20:23:34.136 7f9597a16700 10 monclient(hunting): handle_auth_done global_id 93709081 payload 386
  782. -692> 2020-12-12 20:23:34.136 7f9597a16700 10 monclient: _finish_hunting 0
  783. -691> 2020-12-12 20:23:34.136 7f9597a16700 1 monclient: found mon.tower1
  784. -690> 2020-12-12 20:23:34.136 7f9597a16700 10 monclient: _send_mon_message to mon.tower1 at v2:192.168.8.102:3300/0
  785. -689> 2020-12-12 20:23:34.136 7f9597a16700 10 monclient: _finish_auth 0
  786. -688> 2020-12-12 20:23:34.136 7f9597a16700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2020-12-12 20:23:04.138636)
  787. -687> 2020-12-12 20:23:34.136 7f9597a16700 10 monclient: _send_mon_message to mon.tower1 at v2:192.168.8.102:3300/0
  788. -686> 2020-12-12 20:23:34.136 7f9598450c80 5 monclient: authenticate success, global_id 93709081
  789. -685> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: handle_monmap mon_map magic: 0 v1
  790. -684> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: got monmap 11 from mon.tower1 (according to old e11)
  791. -683> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: dump:
  792. epoch 11
  793. fsid d0b4c175-02ba-4a64-8040-eb163002cba6
  794. last_changed 2020-12-05 09:42:18.637201
  795. created 2020-04-05 17:40:47.148501
  796. min_mon_release 14 (nautilus)
  797. 0: [v2:192.168.8.100:3300/0,v1:192.168.8.100:6789/0] mon.sumib
  798. 1: [v2:192.168.8.102:3300/0,v1:192.168.8.102:6789/0] mon.tower1
  799. 2: [v2:192.168.8.101:3300/0,v1:192.168.8.101:6789/0] mon.sumia
  800.  
  801. -682> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: handle_config config(9 keys) v1
  802. -681> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: handle_monmap mon_map magic: 0 v1
  803. -680> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: got monmap 11 from mon.tower1 (according to old e11)
  804. -679> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: dump:
  805. epoch 11
  806. fsid d0b4c175-02ba-4a64-8040-eb163002cba6
  807. last_changed 2020-12-05 09:42:18.637201
  808. created 2020-04-05 17:40:47.148501
  809. min_mon_release 14 (nautilus)
  810. 0: [v2:192.168.8.100:3300/0,v1:192.168.8.100:6789/0] mon.sumib
  811. 1: [v2:192.168.8.102:3300/0,v1:192.168.8.102:6789/0] mon.tower1
  812. 2: [v2:192.168.8.101:3300/0,v1:192.168.8.101:6789/0] mon.sumia
  813.  
  814. -678> 2020-12-12 20:23:34.136 7f9595211700 4 set_mon_vals no callback set
  815. -677> 2020-12-12 20:23:34.136 7f9595211700 10 set_mon_vals device_failure_prediction_mode = none
  816. -676> 2020-12-12 20:23:34.136 7f9595211700 10 set_mon_vals mon_max_pg_per_osd = 272
  817. -675> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: _finish_auth 0
  818. -674> 2020-12-12 20:23:34.136 7f9595211700 10 set_mon_vals mon_target_pg_per_osd = 100
  819. -673> 2020-12-12 20:23:34.136 7f9596a14700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2020-12-12 20:23:04.138913)
  820. -672> 2020-12-12 20:23:34.136 7f9595211700 10 set_mon_vals osd_pool_default_pg_autoscale_mode = on
  821. -671> 2020-12-12 20:23:34.136 7f9598450c80 10 monclient: get_monmap_and_config success
  822. -670> 2020-12-12 20:23:34.136 7f9595211700 10 set_mon_vals osd_recovery_max_active = 3
  823. -669> 2020-12-12 20:23:34.136 7f9598450c80 10 monclient: shutdown
  824. -668> 2020-12-12 20:23:34.136 7f9595211700 10 set_mon_vals osd_recovery_max_single_start = 1
  825. -667> 2020-12-12 20:23:34.136 7f9595211700 10 set_mon_vals osd_recovery_sleep = 0.000000
  826. -666> 2020-12-12 20:23:34.136 7f9595211700 10 set_mon_vals osd_scrub_auto_repair = true
  827. -665> 2020-12-12 20:23:34.136 7f9598450c80 0 set uid:gid to 64045:64045 (ceph:ceph)
  828. -664> 2020-12-12 20:23:34.136 7f9598450c80 0 ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable), process ceph-osd, pid 797133
  829. -663> 2020-12-12 20:23:34.136 7f9598450c80 0 pidfile_write: ignore empty --pid-file
  830. -662> 2020-12-12 20:23:34.136 7f9598450c80 5 asok(0x55a7250b8000) init /var/run/ceph/ceph-osd.11.asok
  831. -661> 2020-12-12 20:23:34.136 7f9598450c80 5 asok(0x55a7250b8000) bind_and_listen /var/run/ceph/ceph-osd.11.asok
  832. -660> 2020-12-12 20:23:34.136 7f9598450c80 5 asok(0x55a7250b8000) register_command 0 hook 0x55a7250198d0
  833. -659> 2020-12-12 20:23:34.136 7f9598450c80 5 asok(0x55a7250b8000) register_command version hook 0x55a7250198d0
  834. -658> 2020-12-12 20:23:34.136 7f9598450c80 5 asok(0x55a7250b8000) register_command git_version hook 0x55a7250198d0
  835. -657> 2020-12-12 20:23:34.136 7f9598450c80 5 asok(0x55a7250b8000) register_command help hook 0x55a72501a770
  836. -656> 2020-12-12 20:23:34.136 7f9598450c80 5 asok(0x55a7250b8000) register_command get_command_descriptions hook 0x55a72501a780
  837. -655> 2020-12-12 20:23:34.136 7f9598450c80 5 object store type is bluestore
  838. -654> 2020-12-12 20:23:34.136 7f9595a12700 5 asok(0x55a7250b8000) entry start
  839. -653> 2020-12-12 20:23:34.140 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  840. -652> 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  841. -651> 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  842. -650> 2020-12-12 20:23:34.140 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  843. -649> 2020-12-12 20:23:34.140 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore bluefs available hook 0x55a72501a790
  844. -648> 2020-12-12 20:23:34.140 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore bluefs stats hook 0x55a72501a790
  845. -647> 2020-12-12 20:23:34.140 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  846. -646> 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf0e00 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  847. -645> 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf0e00 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  848. -644> 2020-12-12 20:23:34.140 7f9598450c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  849. -643> 2020-12-12 20:23:34.140 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  850. -642> 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf1180 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  851. -641> 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf1180 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  852. -640> 2020-12-12 20:23:34.140 7f9598450c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  853. -639> 2020-12-12 20:23:34.140 7f9598450c80 5 asok(0x55a7250b8000) unregister_commands bluestore bluefs available
  854. -638> 2020-12-12 20:23:34.140 7f9598450c80 5 asok(0x55a7250b8000) unregister_commands bluestore bluefs stats
  855. -637> 2020-12-12 20:23:34.140 7f9598450c80 1 bdev(0x55a725cf0e00 /var/lib/ceph/osd/ceph-11/block.db) close
  856. -636> 2020-12-12 20:23:34.424 7f9598450c80 1 bdev(0x55a725cf1180 /var/lib/ceph/osd/ceph-11/block) close
  857. -635> 2020-12-12 20:23:34.680 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) close
  858. -634> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding auth protocol: cephx
  859. -633> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding auth protocol: cephx
  860. -632> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding auth protocol: cephx
  861. -631> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding con mode: secure
  862. -630> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding con mode: crc
  863. -629> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding con mode: secure
  864. -628> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding con mode: crc
  865. -627> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding con mode: secure
  866. -626> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding con mode: crc
  867. -625> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding con mode: crc
  868. -624> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding con mode: secure
  869. -623> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding con mode: crc
  870. -622> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding con mode: secure
  871. -621> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding con mode: crc
  872. -620> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6140) adding con mode: secure
  873. -619> 2020-12-12 20:23:34.928 7f9598450c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  874. -618> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding auth protocol: cephx
  875. -617> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding auth protocol: cephx
  876. -616> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding auth protocol: cephx
  877. -615> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding con mode: secure
  878. -614> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding con mode: crc
  879. -613> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding con mode: secure
  880. -612> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding con mode: crc
  881. -611> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding con mode: secure
  882. -610> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding con mode: crc
  883. -609> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding con mode: crc
  884. -608> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding con mode: secure
  885. -607> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding con mode: crc
  886. -606> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding con mode: secure
  887. -605> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding con mode: crc
  888. -604> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de6a40) adding con mode: secure
  889. -603> 2020-12-12 20:23:34.928 7f9598450c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  890. -602> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding auth protocol: cephx
  891. -601> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding auth protocol: cephx
  892. -600> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding auth protocol: cephx
  893. -599> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding con mode: secure
  894. -598> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding con mode: crc
  895. -597> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding con mode: secure
  896. -596> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding con mode: crc
  897. -595> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding con mode: secure
  898. -594> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding con mode: crc
  899. -593> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding con mode: crc
  900. -592> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding con mode: secure
  901. -591> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding con mode: crc
  902. -590> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding con mode: secure
  903. -589> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding con mode: crc
  904. -588> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7340) adding con mode: secure
  905. -587> 2020-12-12 20:23:34.928 7f9598450c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  906. -586> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding auth protocol: cephx
  907. -585> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding auth protocol: cephx
  908. -584> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding auth protocol: cephx
  909. -583> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding con mode: secure
  910. -582> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding con mode: crc
  911. -581> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding con mode: secure
  912. -580> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding con mode: crc
  913. -579> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding con mode: secure
  914. -578> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding con mode: crc
  915. -577> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding con mode: crc
  916. -576> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding con mode: secure
  917. -575> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding con mode: crc
  918. -574> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding con mode: secure
  919. -573> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding con mode: crc
  920. -572> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de7c40) adding con mode: secure
  921. -571> 2020-12-12 20:23:34.928 7f9598450c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  922. -570> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding auth protocol: cephx
  923. -569> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding auth protocol: cephx
  924. -568> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding auth protocol: cephx
  925. -567> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding con mode: secure
  926. -566> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding con mode: crc
  927. -565> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding con mode: secure
  928. -564> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding con mode: crc
  929. -563> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding con mode: secure
  930. -562> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding con mode: crc
  931. -561> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding con mode: crc
  932. -560> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding con mode: secure
  933. -559> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding con mode: crc
  934. -558> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding con mode: secure
  935. -557> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding con mode: crc
  936. -556> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8540) adding con mode: secure
  937. -555> 2020-12-12 20:23:34.928 7f9598450c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  938. -554> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding auth protocol: cephx
  939. -553> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding auth protocol: cephx
  940. -552> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding auth protocol: cephx
  941. -551> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding con mode: secure
  942. -550> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding con mode: crc
  943. -549> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding con mode: secure
  944. -548> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding con mode: crc
  945. -547> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding con mode: secure
  946. -546> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding con mode: crc
  947. -545> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding con mode: crc
  948. -544> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding con mode: secure
  949. -543> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding con mode: crc
  950. -542> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding con mode: secure
  951. -541> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding con mode: crc
  952. -540> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de8e40) adding con mode: secure
  953. -539> 2020-12-12 20:23:34.928 7f9598450c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  954. -538> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding auth protocol: cephx
  955. -537> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding auth protocol: cephx
  956. -536> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding auth protocol: cephx
  957. -535> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding con mode: secure
  958. -534> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding con mode: crc
  959. -533> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding con mode: secure
  960. -532> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding con mode: crc
  961. -531> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding con mode: secure
  962. -530> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding con mode: crc
  963. -529> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding con mode: crc
  964. -528> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding con mode: secure
  965. -527> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding con mode: crc
  966. -526> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding con mode: secure
  967. -525> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding con mode: crc
  968. -524> 2020-12-12 20:23:34.928 7f9598450c80 5 AuthRegistry(0x55a725de9740) adding con mode: secure
  969. -523> 2020-12-12 20:23:34.928 7f9598450c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  970. -522> 2020-12-12 20:23:34.928 7f9598450c80 0 starting osd.11 osd_data /var/lib/ceph/osd/ceph-11 /var/lib/ceph/osd/ceph-11/journal
  971. -521> 2020-12-12 20:23:34.936 7f9598450c80 10 monclient: build_initial_monmap
  972. -520> 2020-12-12 20:23:34.940 7f9598450c80 10 monclient: monmap:
  973. epoch 0
  974. fsid 00000000-0000-0000-0000-000000000000
  975. last_changed 0.000000
  976. created 0.000000
  977. min_mon_release 0 (unknown)
  978. 0: [v2:192.168.8.100:3300/0,v1:192.168.8.100:6789/0] mon.noname-b
  979. 1: [v2:192.168.8.101:3300/0,v1:192.168.8.101:6789/0] mon.noname-a
  980. 2: [v2:192.168.8.102:3300/0,v1:192.168.8.102:6789/0] mon.noname-c
  981.  
  982. -519> 2020-12-12 20:23:34.944 7f9598450c80 0 load: jerasure load: lrc load: isa
  983. -518> 2020-12-12 20:23:34.944 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  984. -517> 2020-12-12 20:23:34.944 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  985. -516> 2020-12-12 20:23:34.944 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  986. -515> 2020-12-12 20:23:34.944 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  987. -514> 2020-12-12 20:23:34.944 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) close
  988. -513> 2020-12-12 20:23:35.236 7f9598450c80 5 asok(0x55a7250b8000) register_command objecter_requests hook 0x55a72501a980
  989. -512> 2020-12-12 20:23:35.236 7f9598450c80 2 osd.11 0 init /var/lib/ceph/osd/ceph-11 (looks like hdd)
  990. -511> 2020-12-12 20:23:35.236 7f9598450c80 2 osd.11 0 journal /var/lib/ceph/osd/ceph-11/journal
  991. -510> 2020-12-12 20:23:35.236 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _mount path /var/lib/ceph/osd/ceph-11
  992. -509> 2020-12-12 20:23:35.236 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  993. -508> 2020-12-12 20:23:35.236 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  994. -507> 2020-12-12 20:23:35.236 7f9598450c80 1 bdev(0x55a725cf0000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  995. -506> 2020-12-12 20:23:35.240 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  996. -505> 2020-12-12 20:23:35.240 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore bluefs available hook 0x55a72501a990
  997. -504> 2020-12-12 20:23:35.240 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore bluefs stats hook 0x55a72501a990
  998. -503> 2020-12-12 20:23:35.240 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  999. -502> 2020-12-12 20:23:35.240 7f9598450c80 1 bdev(0x55a725cf1880 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  1000. -501> 2020-12-12 20:23:35.240 7f9598450c80 1 bdev(0x55a725cf1880 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1001. -500> 2020-12-12 20:23:35.240 7f9598450c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  1002. -499> 2020-12-12 20:23:35.240 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  1003. -498> 2020-12-12 20:23:35.240 7f9598450c80 1 bdev(0x55a725cf1500 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  1004. -497> 2020-12-12 20:23:35.240 7f9598450c80 1 bdev(0x55a725cf1500 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1005. -496> 2020-12-12 20:23:35.240 7f9598450c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  1006. -495> 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option compaction_readahead_size = 2097152
  1007. -494> 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option compression = kNoCompression
  1008. -493> 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option max_background_compactions = 2
  1009. -492> 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option max_write_buffer_number = 4
  1010. -491> 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  1011. -490> 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option recycle_log_file_num = 4
  1012. -489> 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option writable_file_max_buffer_size = 0
  1013. -488> 2020-12-12 20:23:35.240 7f9598450c80 0 set rocksdb option write_buffer_size = 268435456
  1014. -487> 2020-12-12 20:23:35.240 7f9598450c80 1 bluefs mount
  1015. -486> 2020-12-12 20:23:35.240 7f9598450c80 1 bluefs _init_alloc id 1 alloc_size 0x100000 size 0x14c8500000
  1016. -485> 2020-12-12 20:23:35.240 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator dump bluefs-db hook 0x55a725df6db0
  1017. -484> 2020-12-12 20:23:35.240 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator score bluefs-db hook 0x55a725df6db0
  1018. -483> 2020-12-12 20:23:35.240 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator fragmentation bluefs-db hook 0x55a725df6db0
  1019. -482> 2020-12-12 20:23:35.240 7f9598450c80 1 bluefs _init_alloc id 2 alloc_size 0x10000 size 0x3a381400000
  1020. -481> 2020-12-12 20:23:35.240 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator dump bluefs-slow hook 0x55a725df6d80
  1021. -480> 2020-12-12 20:23:35.240 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator score bluefs-slow hook 0x55a725df6d80
  1022. -479> 2020-12-12 20:23:35.240 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator fragmentation bluefs-slow hook 0x55a725df6d80
  1023. -478> 2020-12-12 20:23:35.276 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db set db_paths to db,84797030400 db.slow,3800743857356
  1024. -477> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option compaction_readahead_size = 2097152
  1025. -476> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option compression = kNoCompression
  1026. -475> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option max_background_compactions = 2
  1027. -474> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option max_write_buffer_number = 4
  1028. -473> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  1029. -472> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option recycle_log_file_num = 4
  1030. -471> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option writable_file_max_buffer_size = 0
  1031. -470> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option write_buffer_size = 268435456
  1032. -469> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option compaction_readahead_size = 2097152
  1033. -468> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option compression = kNoCompression
  1034. -467> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option max_background_compactions = 2
  1035. -466> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option max_write_buffer_number = 4
  1036. -465> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  1037. -464> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option recycle_log_file_num = 4
  1038. -463> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option writable_file_max_buffer_size = 0
  1039. -462> 2020-12-12 20:23:35.276 7f9598450c80 0 set rocksdb option write_buffer_size = 268435456
  1040. -461> 2020-12-12 20:23:35.276 7f9598450c80 1 rocksdb: do_open column families: [default]
  1041. -460> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: RocksDB version: 6.1.2
  1042.  
  1043. -459> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  1044. -458> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Compile date Dec 2 2020
  1045. -457> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: DB SUMMARY
  1046.  
  1047. -456> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: CURRENT file: CURRENT
  1048.  
  1049. -455> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: IDENTITY file: IDENTITY
  1050.  
  1051. -454> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: MANIFEST file: MANIFEST-003616 size: 6029 Bytes
  1052.  
  1053. -453> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: SST files in db dir, Total Num: 47, files: 000199.sst 000264.sst 000265.sst 000340.sst 000341.sst 000342.sst 000343.sst 000345.sst 000346.sst
  1054.  
  1055. -452> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
  1056.  
  1057. -451> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Write Ahead Log file in db.wal: 003617.log size: 0 ;
  1058.  
  1059. -450> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.error_if_exists: 0
  1060. -449> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.create_if_missing: 0
  1061. -448> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.paranoid_checks: 1
  1062. -447> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.env: 0x55a725da2e40
  1063. -446> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.info_log: 0x55a725da3860
  1064. -445> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_file_opening_threads: 16
  1065. -444> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.statistics: (nil)
  1066. -443> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.use_fsync: 0
  1067. -442> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_log_file_size: 0
  1068. -441> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
  1069. -440> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.log_file_time_to_roll: 0
  1070. -439> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.keep_log_file_num: 1000
  1071. -438> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.recycle_log_file_num: 4
  1072. -437> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.allow_fallocate: 1
  1073. -436> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.allow_mmap_reads: 0
  1074. -435> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.allow_mmap_writes: 0
  1075. -434> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.use_direct_reads: 0
  1076. -433> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  1077. -432> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.create_missing_column_families: 0
  1078. -431> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.db_log_dir:
  1079. -430> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.wal_dir: db.wal
  1080. -429> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.table_cache_numshardbits: 6
  1081. -428> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_subcompactions: 1
  1082. -427> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_background_flushes: -1
  1083. -426> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.WAL_ttl_seconds: 0
  1084. -425> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.WAL_size_limit_MB: 0
  1085. -424> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
  1086. -423> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.is_fd_close_on_exec: 1
  1087. -422> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.advise_random_on_open: 1
  1088. -421> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.db_write_buffer_size: 0
  1089. -420> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.write_buffer_manager: 0x55a725df7080
  1090. -419> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
  1091. -418> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  1092. -417> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  1093. -416> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.use_adaptive_mutex: 0
  1094. -415> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.rate_limiter: (nil)
  1095. -414> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  1096. -413> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.wal_recovery_mode: 0
  1097. -412> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.enable_thread_tracking: 0
  1098. -411> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.enable_pipelined_write: 0
  1099. -410> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  1100. -409> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  1101. -408> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
  1102. -407> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  1103. -406> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.row_cache: None
  1104. -405> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.wal_filter: None
  1105. -404> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
  1106. -403> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.allow_ingest_behind: 0
  1107. -402> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.preserve_deletes: 0
  1108. -401> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.two_write_queues: 0
  1109. -400> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.manual_wal_flush: 0
  1110. -399> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.atomic_flush: 0
  1111. -398> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  1112. -397> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_background_jobs: 2
  1113. -396> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_background_compactions: 2
  1114. -395> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  1115. -394> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.writable_file_max_buffer_size: 0
  1116. -393> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.delayed_write_rate : 16777216
  1117. -392> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_total_wal_size: 0
  1118. -391> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  1119. -390> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.stats_dump_period_sec: 600
  1120. -389> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.stats_persist_period_sec: 600
  1121. -388> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
  1122. -387> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_open_files: -1
  1123. -386> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bytes_per_sync: 0
  1124. -385> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.wal_bytes_per_sync: 0
  1125. -384> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_readahead_size: 2097152
  1126. -383> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Compression algorithms supported:
  1127. -382> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
  1128. -381> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kZSTD supported: 0
  1129. -380> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kXpressCompression supported: 0
  1130. -379> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kLZ4HCCompression supported: 1
  1131. -378> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kLZ4Compression supported: 1
  1132. -377> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kBZip2Compression supported: 0
  1133. -376> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kZlibCompression supported: 1
  1134. -375> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: kSnappyCompression supported: 1
  1135. -374> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Fast CRC32 supported: Supported on x86
  1136. -373> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: [db/db_impl_readonly.cc:22] Opening the db in read only mode
  1137. -372> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-003616
  1138.  
  1139. -371> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  1140.  
  1141. -370> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  1142. -369> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  1143. -368> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_filter: None
  1144. -367> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_filter_factory: None
  1145. -366> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.memtable_factory: SkipListFactory
  1146. -365> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.table_factory: BlockBasedTable
  1147. -364> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a725019360)
  1148. cache_index_and_filter_blocks: 1
  1149. cache_index_and_filter_blocks_with_high_priority: 1
  1150. pin_l0_filter_and_index_blocks_in_cache: 0
  1151. pin_top_level_index_and_filter: 1
  1152. index_type: 0
  1153. data_block_index_type: 0
  1154. data_block_hash_table_util_ratio: 0.750000
  1155. hash_index_allow_collision: 1
  1156. checksum: 1
  1157. no_block_cache: 0
  1158. block_cache: 0x55a725062a10
  1159. block_cache_name: BinnedLRUCache
  1160. block_cache_options:
  1161. capacity : 429496729
  1162. num_shard_bits : 4
  1163. strict_capacity_limit : 0
  1164. high_pri_pool_ratio: 0.000
  1165. block_cache_compressed: (nil)
  1166. persistent_cache: (nil)
  1167. block_size: 4096
  1168. block_size_deviation: 10
  1169. block_restart_interval: 16
  1170. index_block_restart_interval: 1
  1171. metadata_block_size: 4096
  1172. partition_filters: 0
  1173. use_delta_encoding: 1
  1174. filter_policy: rocksdb.BuiltinBloomFilter
  1175. whole_key_filtering: 1
  1176. verify_compression: 0
  1177. read_amp_bytes_per_bit: 0
  1178. format_version: 2
  1179. enable_index_compression: 1
  1180. block_align: 0
  1181.  
  1182. -363> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.write_buffer_size: 268435456
  1183. -362> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_write_buffer_number: 4
  1184. -361> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression: NoCompression
  1185. -360> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression: Disabled
  1186. -359> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.prefix_extractor: nullptr
  1187. -358> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  1188. -357> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.num_levels: 7
  1189. -356> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  1190. -355> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  1191. -354> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  1192. -353> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  1193. -352> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  1194. -351> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  1195. -350> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  1196. -349> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  1197. -348> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression_opts.window_bits: -14
  1198. -347> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression_opts.level: 32767
  1199. -346> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression_opts.strategy: 0
  1200. -345> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  1201. -344> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  1202. -343> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compression_opts.enabled: false
  1203. -342> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  1204. -341> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  1205. -340> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
  1206. -339> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.target_file_size_base: 67108864
  1207. -338> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.target_file_size_multiplier: 1
  1208. -337> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  1209. -336> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  1210. -335> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  1211. -334> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  1212. -333> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  1213. -332> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  1214. -331> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  1215. -330> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  1216. -329> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  1217. -328> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  1218. -327> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  1219. -326> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
  1220. -325> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.arena_block_size: 33554432
  1221. -324> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  1222. -323> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  1223. -322> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  1224. -321> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.disable_auto_compactions: 0
  1225. -320> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  1226. -319> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  1227. -318> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  1228. -317> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  1229. -316> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  1230. -315> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  1231. -314> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  1232. -313> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  1233. -312> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  1234. -311> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  1235. -310> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.table_properties_collectors:
  1236. -309> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.inplace_update_support: 0
  1237. -308> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.inplace_update_num_locks: 10000
  1238. -307> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  1239. -306> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
  1240. -305> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.memtable_huge_page_size: 0
  1241. -304> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.bloom_locality: 0
  1242. -303> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.max_successive_merges: 0
  1243. -302> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.optimize_filters_for_hits: 0
  1244. -301> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.paranoid_file_checks: 0
  1245. -300> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.force_consistency_checks: 0
  1246. -299> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.report_bg_io_stats: 0
  1247. -298> 2020-12-12 20:23:35.276 7f9598450c80 4 rocksdb: Options.ttl: 0
  1248. -297> 2020-12-12 20:23:35.280 7f9598450c80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-003616 succeeded,manifest_file_number is 3616, next_file_number is 3618, last_sequence is 22382894, log_number is 3615,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  1249.  
  1250. -296> 2020-12-12 20:23:35.280 7f9598450c80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 3615
  1251.  
  1252. -295> 2020-12-12 20:23:35.280 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015284920, "job": 1, "event": "recovery_started", "log_files": [3617]}
  1253. -294> 2020-12-12 20:23:35.280 7f9598450c80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3617 mode 0
  1254. -293> 2020-12-12 20:23:35.280 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015284940, "job": 1, "event": "recovery_finished"}
  1255. -292> 2020-12-12 20:23:35.280 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  1256. -291> 2020-12-12 20:23:35.288 7f9598450c80 1 get compressor snappy = 0
  1257. -290> 2020-12-12 20:23:35.288 7f9598450c80 1 load compressor snappy
  1258. -289> 2020-12-12 20:23:35.288 7f9598450c80 1 add compressor snappy 0x55a726075050
  1259. -288> 2020-12-12 20:23:35.288 7f9598450c80 1 get compressor snappy = 0x55a726075050
  1260. -287> 2020-12-12 20:23:35.288 7f9598450c80 1 load: compressor snappy loaded and registered
  1261. -286> 2020-12-12 20:23:35.288 7f9598450c80 1 get compressor snappy = 0x55a726075050
  1262. -285> 2020-12-12 20:23:35.288 7f9598450c80 1 freelist init
  1263. -284> 2020-12-12 20:23:35.292 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator dump block hook 0x55a725df72f0
  1264. -283> 2020-12-12 20:23:35.292 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator score block hook 0x55a725df72f0
  1265. -282> 2020-12-12 20:23:35.292 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator fragmentation block hook 0x55a725df72f0
  1266. -281> 2020-12-12 20:23:35.292 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_alloc opening allocation metadata
  1267. -280> 2020-12-12 20:23:35.440 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_alloc loaded 2.3 TiB in 139875 extents available 2.2 TiB
  1268. -279> 2020-12-12 20:23:35.440 7f9598450c80 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work
  1269. -278> 2020-12-12 20:23:35.440 7f9598450c80 4 rocksdb: [db/db_impl.cc:563] Shutdown complete
  1270. -277> 2020-12-12 20:23:35.440 7f9598450c80 1 bluefs umount
  1271. -276> 2020-12-12 20:23:35.440 7f9598450c80 5 asok(0x55a7250b8000) unregister_command bluestore allocator dump bluefs-db
  1272. -275> 2020-12-12 20:23:35.440 7f9598450c80 5 asok(0x55a7250b8000) unregister_command bluestore allocator score bluefs-db
  1273. -274> 2020-12-12 20:23:35.440 7f9598450c80 5 asok(0x55a7250b8000) unregister_command bluestore allocator fragmentation bluefs-db
  1274. -273> 2020-12-12 20:23:35.440 7f9598450c80 5 asok(0x55a7250b8000) unregister_command bluestore allocator dump bluefs-slow
  1275. -272> 2020-12-12 20:23:35.440 7f9598450c80 5 asok(0x55a7250b8000) unregister_command bluestore allocator score bluefs-slow
  1276. -271> 2020-12-12 20:23:35.440 7f9598450c80 5 asok(0x55a7250b8000) unregister_command bluestore allocator fragmentation bluefs-slow
  1277. -270> 2020-12-12 20:23:35.440 7f9598450c80 5 asok(0x55a7250b8000) unregister_commands bluestore bluefs available
  1278. -269> 2020-12-12 20:23:35.440 7f9598450c80 5 asok(0x55a7250b8000) unregister_commands bluestore bluefs stats
  1279. -268> 2020-12-12 20:23:35.440 7f9598450c80 1 bdev(0x55a725cf1880 /var/lib/ceph/osd/ceph-11/block.db) close
  1280. -267> 2020-12-12 20:23:35.520 7f9598450c80 1 bdev(0x55a725cf1500 /var/lib/ceph/osd/ceph-11/block) close
  1281. -266> 2020-12-12 20:23:35.788 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore bluefs available hook 0x55a72501a990
  1282. -265> 2020-12-12 20:23:35.788 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore bluefs stats hook 0x55a72501a990
  1283. -264> 2020-12-12 20:23:35.788 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  1284. -263> 2020-12-12 20:23:35.788 7f9598450c80 1 bdev(0x55a725cf1500 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  1285. -262> 2020-12-12 20:23:35.788 7f9598450c80 1 bdev(0x55a725cf1500 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1286. -261> 2020-12-12 20:23:35.788 7f9598450c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  1287. -260> 2020-12-12 20:23:35.788 7f9598450c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  1288. -259> 2020-12-12 20:23:35.788 7f9598450c80 1 bdev(0x55a725cf1880 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  1289. -258> 2020-12-12 20:23:35.788 7f9598450c80 1 bdev(0x55a725cf1880 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1290. -257> 2020-12-12 20:23:35.788 7f9598450c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  1291. -256> 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option compaction_readahead_size = 2097152
  1292. -255> 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option compression = kNoCompression
  1293. -254> 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option max_background_compactions = 2
  1294. -253> 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option max_write_buffer_number = 4
  1295. -252> 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  1296. -251> 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option recycle_log_file_num = 4
  1297. -250> 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option writable_file_max_buffer_size = 0
  1298. -249> 2020-12-12 20:23:35.788 7f9598450c80 0 set rocksdb option write_buffer_size = 268435456
  1299. -248> 2020-12-12 20:23:35.788 7f9598450c80 1 bluefs mount
  1300. -247> 2020-12-12 20:23:35.788 7f9598450c80 1 bluefs _init_alloc id 1 alloc_size 0x100000 size 0x14c8500000
  1301. -246> 2020-12-12 20:23:35.788 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator dump bluefs-db hook 0x55a725df6f30
  1302. -245> 2020-12-12 20:23:35.788 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator score bluefs-db hook 0x55a725df6f30
  1303. -244> 2020-12-12 20:23:35.788 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator fragmentation bluefs-db hook 0x55a725df6f30
  1304. -243> 2020-12-12 20:23:35.788 7f9598450c80 1 bluefs _init_alloc id 2 alloc_size 0x10000 size 0x3a381400000
  1305. -242> 2020-12-12 20:23:35.788 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator dump bluefs-slow hook 0x55a725df6f00
  1306. -241> 2020-12-12 20:23:35.788 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator score bluefs-slow hook 0x55a725df6f00
  1307. -240> 2020-12-12 20:23:35.788 7f9598450c80 5 asok(0x55a7250b8000) register_command bluestore allocator fragmentation bluefs-slow hook 0x55a725df6f00
  1308. -239> 2020-12-12 20:23:35.820 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db set db_paths to db,84797030400 db.slow,3800743857356
  1309. -238> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option compaction_readahead_size = 2097152
  1310. -237> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option compression = kNoCompression
  1311. -236> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option max_background_compactions = 2
  1312. -235> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option max_write_buffer_number = 4
  1313. -234> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  1314. -233> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option recycle_log_file_num = 4
  1315. -232> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option writable_file_max_buffer_size = 0
  1316. -231> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option write_buffer_size = 268435456
  1317. -230> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option compaction_readahead_size = 2097152
  1318. -229> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option compression = kNoCompression
  1319. -228> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option max_background_compactions = 2
  1320. -227> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option max_write_buffer_number = 4
  1321. -226> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  1322. -225> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option recycle_log_file_num = 4
  1323. -224> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option writable_file_max_buffer_size = 0
  1324. -223> 2020-12-12 20:23:35.820 7f9598450c80 0 set rocksdb option write_buffer_size = 268435456
  1325. -222> 2020-12-12 20:23:35.820 7f9598450c80 1 rocksdb: do_open column families: [default]
  1326. -221> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: RocksDB version: 6.1.2
  1327.  
  1328. -220> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  1329. -219> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Compile date Dec 2 2020
  1330. -218> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: DB SUMMARY
  1331.  
  1332. -217> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: CURRENT file: CURRENT
  1333.  
  1334. -216> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: IDENTITY file: IDENTITY
  1335.  
  1336. -215> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: MANIFEST file: MANIFEST-003616 size: 6029 Bytes
  1337.  
  1338. -214> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: SST files in db dir, Total Num: 47, files: 000199.sst 000264.sst 000265.sst 000340.sst 000341.sst 000342.sst 000343.sst 000345.sst 000346.sst
  1339.  
  1340. -213> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
  1341.  
  1342. -212> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Write Ahead Log file in db.wal: 003617.log size: 0 ;
  1343.  
  1344. -211> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.error_if_exists: 0
  1345. -210> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.create_if_missing: 0
  1346. -209> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.paranoid_checks: 1
  1347. -208> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.env: 0x55a7264c4e00
  1348. -207> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.info_log: 0x55a72679b980
  1349. -206> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.max_file_opening_threads: 16
  1350. -205> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.statistics: (nil)
  1351. -204> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.use_fsync: 0
  1352. -203> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.max_log_file_size: 0
  1353. -202> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
  1354. -201> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.log_file_time_to_roll: 0
  1355. -200> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.keep_log_file_num: 1000
  1356. -199> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.recycle_log_file_num: 4
  1357. -198> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.allow_fallocate: 1
  1358. -197> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.allow_mmap_reads: 0
  1359. -196> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.allow_mmap_writes: 0
  1360. -195> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.use_direct_reads: 0
  1361. -194> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  1362. -193> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.create_missing_column_families: 0
  1363. -192> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.db_log_dir:
  1364. -191> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.wal_dir: db.wal
  1365. -190> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.table_cache_numshardbits: 6
  1366. -189> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.max_subcompactions: 1
  1367. -188> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.max_background_flushes: -1
  1368. -187> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.WAL_ttl_seconds: 0
  1369. -186> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.WAL_size_limit_MB: 0
  1370. -185> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
  1371. -184> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.is_fd_close_on_exec: 1
  1372. -183> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.advise_random_on_open: 1
  1373. -182> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.db_write_buffer_size: 0
  1374. -181> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.write_buffer_manager: 0x55a726030a50
  1375. -180> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
  1376. -179> 2020-12-12 20:23:35.820 7f9598450c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  1377. -178> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  1378. -177> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.use_adaptive_mutex: 0
  1379. -176> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.rate_limiter: (nil)
  1380. -175> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  1381. -174> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.wal_recovery_mode: 0
  1382. -173> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.enable_thread_tracking: 0
  1383. -172> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.enable_pipelined_write: 0
  1384. -171> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  1385. -170> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  1386. -169> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
  1387. -168> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  1388. -167> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.row_cache: None
  1389. -166> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.wal_filter: None
  1390. -165> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
  1391. -164> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.allow_ingest_behind: 0
  1392. -163> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.preserve_deletes: 0
  1393. -162> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.two_write_queues: 0
  1394. -161> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.manual_wal_flush: 0
  1395. -160> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.atomic_flush: 0
  1396. -159> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  1397. -158> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_background_jobs: 2
  1398. -157> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_background_compactions: 2
  1399. -156> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  1400. -155> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.writable_file_max_buffer_size: 0
  1401. -154> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.delayed_write_rate : 16777216
  1402. -153> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_total_wal_size: 0
  1403. -152> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  1404. -151> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.stats_dump_period_sec: 600
  1405. -150> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.stats_persist_period_sec: 600
  1406. -149> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
  1407. -148> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_open_files: -1
  1408. -147> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bytes_per_sync: 0
  1409. -146> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.wal_bytes_per_sync: 0
  1410. -145> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_readahead_size: 2097152
  1411. -144> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Compression algorithms supported:
  1412. -143> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
  1413. -142> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kZSTD supported: 0
  1414. -141> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kXpressCompression supported: 0
  1415. -140> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kLZ4HCCompression supported: 1
  1416. -139> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kLZ4Compression supported: 1
  1417. -138> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kBZip2Compression supported: 0
  1418. -137> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kZlibCompression supported: 1
  1419. -136> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: kSnappyCompression supported: 1
  1420. -135> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Fast CRC32 supported: Supported on x86
  1421. -134> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-003616
  1422.  
  1423. -133> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  1424.  
  1425. -132> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  1426. -131> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  1427. -130> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_filter: None
  1428. -129> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_filter_factory: None
  1429. -128> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.memtable_factory: SkipListFactory
  1430. -127> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.table_factory: BlockBasedTable
  1431. -126> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a725114258)
  1432. cache_index_and_filter_blocks: 1
  1433. cache_index_and_filter_blocks_with_high_priority: 1
  1434. pin_l0_filter_and_index_blocks_in_cache: 0
  1435. pin_top_level_index_and_filter: 1
  1436. index_type: 0
  1437. data_block_index_type: 0
  1438. data_block_hash_table_util_ratio: 0.750000
  1439. hash_index_allow_collision: 1
  1440. checksum: 1
  1441. no_block_cache: 0
  1442. block_cache: 0x55a725062910
  1443. block_cache_name: BinnedLRUCache
  1444. block_cache_options:
  1445. capacity : 429496729
  1446. num_shard_bits : 4
  1447. strict_capacity_limit : 0
  1448. high_pri_pool_ratio: 0.000
  1449. block_cache_compressed: (nil)
  1450. persistent_cache: (nil)
  1451. block_size: 4096
  1452. block_size_deviation: 10
  1453. block_restart_interval: 16
  1454. index_block_restart_interval: 1
  1455. metadata_block_size: 4096
  1456. partition_filters: 0
  1457. use_delta_encoding: 1
  1458. filter_policy: rocksdb.BuiltinBloomFilter
  1459. whole_key_filtering: 1
  1460. verify_compression: 0
  1461. read_amp_bytes_per_bit: 0
  1462. format_version: 2
  1463. enable_index_compression: 1
  1464. block_align: 0
  1465.  
  1466. -125> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.write_buffer_size: 268435456
  1467. -124> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_write_buffer_number: 4
  1468. -123> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression: NoCompression
  1469. -122> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression: Disabled
  1470. -121> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.prefix_extractor: nullptr
  1471. -120> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  1472. -119> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.num_levels: 7
  1473. -118> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  1474. -117> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  1475. -116> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  1476. -115> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  1477. -114> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  1478. -113> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  1479. -112> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  1480. -111> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  1481. -110> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression_opts.window_bits: -14
  1482. -109> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression_opts.level: 32767
  1483. -108> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression_opts.strategy: 0
  1484. -107> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  1485. -106> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  1486. -105> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compression_opts.enabled: false
  1487. -104> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  1488. -103> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  1489. -102> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
  1490. -101> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.target_file_size_base: 67108864
  1491. -100> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.target_file_size_multiplier: 1
  1492. -99> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  1493. -98> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  1494. -97> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  1495. -96> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  1496. -95> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  1497. -94> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  1498. -93> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  1499. -92> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  1500. -91> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  1501. -90> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  1502. -89> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  1503. -88> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
  1504. -87> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.arena_block_size: 33554432
  1505. -86> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  1506. -85> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  1507. -84> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  1508. -83> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.disable_auto_compactions: 0
  1509. -82> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  1510. -81> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  1511. -80> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  1512. -79> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  1513. -78> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  1514. -77> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  1515. -76> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  1516. -75> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  1517. -74> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  1518. -73> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  1519. -72> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.table_properties_collectors:
  1520. -71> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.inplace_update_support: 0
  1521. -70> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.inplace_update_num_locks: 10000
  1522. -69> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  1523. -68> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
  1524. -67> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.memtable_huge_page_size: 0
  1525. -66> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.bloom_locality: 0
  1526. -65> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.max_successive_merges: 0
  1527. -64> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.optimize_filters_for_hits: 0
  1528. -63> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.paranoid_file_checks: 0
  1529. -62> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.force_consistency_checks: 0
  1530. -61> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.report_bg_io_stats: 0
  1531. -60> 2020-12-12 20:23:35.824 7f9598450c80 4 rocksdb: Options.ttl: 0
  1532. -59> 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-003616 succeeded,manifest_file_number is 3616, next_file_number is 3618, last_sequence is 22382894, log_number is 3615,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  1533.  
  1534. -58> 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 3615
  1535.  
  1536. -57> 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015830430, "job": 1, "event": "recovery_started", "log_files": [3617]}
  1537. -56> 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3617 mode 0
  1538. -55> 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: [db/version_set.cc:3036] Creating manifest 3619
  1539.  
  1540. -54> 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015832702, "job": 1, "event": "recovery_finished"}
  1541. -53> 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015832821, "job": 2, "event": "table_file_deletion", "file_number": 3623}
  1542. -52> 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015832838, "job": 2, "event": "table_file_deletion", "file_number": 3622}
  1543. -51> 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015832844, "job": 2, "event": "table_file_deletion", "file_number": 3621}
  1544. -50> 2020-12-12 20:23:35.828 7f9598450c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015832850, "job": 2, "event": "table_file_deletion", "file_number": 3620}
  1545. -49> 2020-12-12 20:23:35.832 7f9598450c80 4 rocksdb: DB pointer 0x55a726324000
  1546. -48> 2020-12-12 20:23:35.832 7f958d972700 4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 3] Compacting 1@1 + 4@2 files to L2, score 1.03
  1547. -47> 2020-12-12 20:23:35.832 7f958d972700 4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 2 Base level 1, inputs: [449(64MB)], [345(64MB) 346(64MB) 347(64MB) 348(64MB)]
  1548.  
  1549. -46> 2020-12-12 20:23:35.832 7f958d972700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837015835357, "job": 3, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [449], "files_L2": [345, 346, 347, 348], "score": 1.02872, "input_data_size": 338693918}
  1550. -45> 2020-12-12 20:23:35.832 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  1551. -44> 2020-12-12 20:23:35.832 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _upgrade_super from 2, latest 2
  1552. -43> 2020-12-12 20:23:35.832 7f9598450c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _upgrade_super done
  1553. -42> 2020-12-12 20:23:35.832 7f9584960700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS -------
  1554. -41> 2020-12-12 20:23:35.832 7f9584960700 4 rocksdb: [db/db_impl.cc:778]
  1555. ** DB Stats **
  1556. Uptime(secs): 0.0 total, 0.0 interval
  1557. Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
  1558. Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
  1559. Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
  1560. Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
  1561. Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
  1562. Interval stall: 00:00:0.000 H:M:S, 0.0 percent
  1563.  
  1564. ** Compaction Stats [default] **
  1565. Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  1566. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  1567. L0 2/0 3.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  1568. L1 4/1 194.65 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  1569. L2 37/4 2.22 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  1570. Sum 43/5 2.41 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  1571. Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  1572.  
  1573. ** Compaction Stats [default] **
  1574. Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  1575. -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  1576. Uptime(secs): 0.0 total, 0.0 interval
  1577. Flush(GB): cumulative 0.000, interval 0.000
  1578. AddFile(GB): cumulative 0.000, interval 0.000
  1579. AddFile(Total Files): cumulative 0, interval 0
  1580. AddFile(L0 Files): cumulative 0, interval 0
  1581. AddFile(Keys): cumulative 0, interval 0
  1582. Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  1583. Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  1584. Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
  1585.  
  1586. ** File Read Latency Histogram By Level [default] **
  1587.  
  1588. ** Compaction Stats [default] **
  1589. Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  1590. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  1591. L0 2/0 3.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  1592. L1 4/1 194.65 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  1593. L2 37/4 2.22 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  1594. Sum 43/5 2.41 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  1595. Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  1596.  
  1597. ** Compaction Stats [default] **
  1598. Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  1599. -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  1600. Uptime(secs): 0.0 total, 0.0 interval
  1601. Flush(GB): cumulative 0.000, interval 0.000
  1602. AddFile(GB): cumulative 0.000, interval 0.000
  1603. AddFile(Total Files): cumulative 0, interval 0
  1604. AddFile(L0 Files): cumulative 0, interval 0
  1605. AddFile(Keys): cumulative 0, interval 0
  1606. Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  1607. Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  1608. Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
  1609.  
  1610. ** File Read Latency Histogram By Level [default] **
  1611.  
  1612. -40> 2020-12-12 20:23:35.872 7f9598450c80 2 osd.11 0 journal looks like ssd
  1613. -39> 2020-12-12 20:23:35.872 7f9598450c80 2 osd.11 0 boot
  1614. -38> 2020-12-12 20:23:35.872 7f958a96c700 5 prioritycache tune_memory target: 4294967296 mapped: 47849472 unmapped: 802816 heap: 48652288 old mem: 134217728 new mem: 2815210853
  1615. -37> 2020-12-12 20:23:35.872 7f958a96c700 5 prioritycache tune_memory target: 4294967296 mapped: 48504832 unmapped: 1196032 heap: 49700864 old mem: 2815210853 new mem: 2845074715
  1616. -36> 2020-12-12 20:23:35.872 7f958a96c700 5 bluestore.MempoolThread(0x55a725db1b70) _trim_shards cache_size: 2845074715 kv_alloc: 1056964608 kv_used: 3206336 meta_alloc: 1056964608 meta_used: 15896 data_alloc: 671088640 data_used: 0
  1617. -35> 2020-12-12 20:23:35.896 7f9598450c80 0 _get_class not permitted to load sdk
  1618. -34> 2020-12-12 20:23:35.896 7f9598450c80 0 <cls> /build/ceph/ceph-14.2.15/src/cls/hello/cls_hello.cc:296: loading cls_hello
  1619. -33> 2020-12-12 20:23:35.896 7f9598450c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/user/cls_user.cc:429: Loaded user class!
  1620. -32> 2020-12-12 20:23:35.896 7f9598450c80 0 _get_class not permitted to load lua
  1621. -31> 2020-12-12 20:23:35.896 7f9598450c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/refcount/cls_refcount.cc:198: Loaded refcount class!
  1622. -30> 2020-12-12 20:23:35.896 7f9598450c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/timeindex/cls_timeindex.cc:242: Loaded timeindex class!
  1623. -29> 2020-12-12 20:23:35.900 7f9598450c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/rgw/cls_rgw.cc:3905: Loaded rgw class!
  1624. -28> 2020-12-12 20:23:35.900 7f9598450c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/log/cls_log.cc:299: Loaded log class!
  1625. -27> 2020-12-12 20:23:35.900 7f9598450c80 0 _get_class not permitted to load kvs
  1626. -26> 2020-12-12 20:23:35.900 7f9598450c80 0 <cls> /build/ceph/ceph-14.2.15/src/cls/cephfs/cls_cephfs.cc:197: loading cephfs
  1627. -25> 2020-12-12 20:23:35.900 7f9598450c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/cas/cls_cas.cc:237: Loaded cas class!
  1628. -24> 2020-12-12 20:23:35.900 7f9598450c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/version/cls_version.cc:214: Loaded version class!
  1629. -23> 2020-12-12 20:23:35.900 7f9598450c80 0 osd.11 120674 crush map has features 432629308056666112, adjusting msgr requires for clients
  1630. -22> 2020-12-12 20:23:35.900 7f9598450c80 0 osd.11 120674 crush map has features 432629308056666112 was 8705, adjusting msgr requires for mons
  1631. -21> 2020-12-12 20:23:35.900 7f9598450c80 0 osd.11 120674 crush map has features 3314933069573799936, adjusting msgr requires for osds
  1632. -20> 2020-12-12 20:23:36.240 7f958d972700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3623: 42754 keys, 67717992 bytes
  1633. -19> 2020-12-12 20:23:36.240 7f958d972700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837016242727, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3623, "file_size": 67717992, "table_properties": {"data_size": 67112720, "index_size": 497464, "filter_size": 106949, "raw_key_size": 2795150, "raw_average_key_size": 65, "raw_value_size": 64371790, "raw_average_value_size": 1505, "num_data_blocks": 14079, "num_entries": 42754, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  1634. -18> 2020-12-12 20:23:36.644 7f958d972700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3624: 43658 keys, 67732235 bytes
  1635. -17> 2020-12-12 20:23:36.644 7f958d972700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837016648741, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3624, "file_size": 67732235, "table_properties": {"data_size": 67111811, "index_size": 510312, "filter_size": 109253, "raw_key_size": 3756526, "raw_average_key_size": 86, "raw_value_size": 63462002, "raw_average_value_size": 1453, "num_data_blocks": 14230, "num_entries": 43658, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  1636. -16> 2020-12-12 20:23:36.876 7f958a96c700 5 prioritycache tune_memory target: 4294967296 mapped: 131096576 unmapped: 2490368 heap: 133586944 old mem: 2845074715 new mem: 2845405420
  1637. -15> 2020-12-12 20:23:37.036 7f958d972700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3625: 43657 keys, 67729297 bytes
  1638. -14> 2020-12-12 20:23:37.036 7f958d972700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837017040542, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3625, "file_size": 67729297, "table_properties": {"data_size": 67113092, "index_size": 506093, "filter_size": 109253, "raw_key_size": 3372528, "raw_average_key_size": 77, "raw_value_size": 63853503, "raw_average_value_size": 1462, "num_data_blocks": 14172, "num_entries": 43657, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  1639. -13> 2020-12-12 20:23:37.424 7f958d972700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3626: 42522 keys, 67713983 bytes
  1640. -12> 2020-12-12 20:23:37.424 7f958d972700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837017427259, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3626, "file_size": 67713983, "table_properties": {"data_size": 67112021, "index_size": 494666, "filter_size": 106437, "raw_key_size": 2680741, "raw_average_key_size": 63, "raw_value_size": 64464845, "raw_average_value_size": 1516, "num_data_blocks": 14067, "num_entries": 42522, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  1641. -11> 2020-12-12 20:23:37.604 7f9598450c80 0 osd.11 120674 load_pgs
  1642. -10> 2020-12-12 20:23:37.696 7f958d972700 3 rocksdb: [db/db_impl_compaction_flush.cc:2660] Compaction error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704
  1643. -9> 2020-12-12 20:23:37.696 7f958d972700 4 rocksdb: (Original Log Time 2020/12/12-20:23:37.699824) [db/compaction_job.cc:768] [default] compacted to: files[2 4 37 0 0 0 0] max score 0.79, MB/sec: 181.7 rd, 145.3 wr, level 2, files in(1, 4) out(5) MB in(64.7, 258.3) out(258.3), read-write-amplify(9.0) write-amplify(4.0) Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704, records in: 243696, records dropped: 28515 output_compression: NoCompression
  1644.  
  1645. -8> 2020-12-12 20:23:37.696 7f958d972700 4 rocksdb: (Original Log Time 2020/12/12-20:23:37.699887) EVENT_LOG_v1 {"time_micros": 1607837017699858, "job": 3, "event": "compaction_finished", "compaction_time_micros": 1864418, "compaction_time_cpu_micros": 461426, "output_level": 2, "num_output_files": 5, "total_output_size": 318240797, "num_input_records": 231169, "num_output_records": 202654, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [2, 4, 37, 0, 0, 0, 0]}
  1646. -7> 2020-12-12 20:23:37.696 7f958d972700 2 rocksdb: [db/db_impl_compaction_flush.cc:2212] Waiting after background compaction error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704, Accumulated background error counts: 1
  1647. -6> 2020-12-12 20:23:37.700 7f9598450c80 5 osd.11 pg_epoch: 120674 pg[19.fs2(unlocked)] enter Initial
  1648. -5> 2020-12-12 20:23:37.784 7f9598450c80 5 osd.11 pg_epoch: 120674 pg[19.fs2( v 120655'13314733 (120632'13311706,120655'13314733] lb 19:f6f3c78a:::rbd_data.16.9bfacae1273d4e.000000000003951a:head (bitwise) local-lis/les=120084/120085 n=45780 ec=1670/1670 lis/c 120666/119858 les/c/f 120667/119859/0 120674/120674/120674) [2147483647,0,11,7,1,5]/[2147483647,0,8,2147483647,1,5]p0(1) r=-1 lpr=0 pi=[119858,120674)/5 crt=120655'13314733 lcod 0'0 unknown mbc={} ps=[2cd~1,2cf~1,2d1~2,2d4~1,2d6~1,2d8~1,2da~1,2dd~1]] exit Initial 0.084138 0 0.000000
  1649. -4> 2020-12-12 20:23:37.788 7f9598450c80 5 osd.11 pg_epoch: 120674 pg[19.fs2( v 120655'13314733 (120632'13311706,120655'13314733] lb 19:f6f3c78a:::rbd_data.16.9bfacae1273d4e.000000000003951a:head (bitwise) local-lis/les=120084/120085 n=45780 ec=1670/1670 lis/c 120666/119858 les/c/f 120667/119859/0 120674/120674/120674) [2147483647,0,11,7,1,5]/[2147483647,0,8,2147483647,1,5]p0(1) r=-1 lpr=0 pi=[119858,120674)/5 crt=120655'13314733 lcod 0'0 unknown mbc={} ps=[2cd~1,2cf~1,2d1~2,2d4~1,2d6~1,2d8~1,2da~1,2dd~1]] enter Reset
  1650. -3> 2020-12-12 20:23:37.788 7f958b96e700 -1 rocksdb: submit_common error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704 code = 2 Rocksdb transaction:
  1651. Put( Prefix = P key = 0x000000000000146e'.can_rollback_to' Value size = 12)
  1652. Put( Prefix = P key = 0x000000000000146e'.rollback_info_trimmed_to' Value size = 12)
  1653. Put( Prefix = O key = 0x828000000000000013f000000021213dfffffffffffffffeffffffffffffffff'o' Value size = 29)
  1654. Put( Prefix = S key = 'nid_max' Value size = 8)
  1655. Put( Prefix = S key = 'blobid_max' Value size = 8)
  1656. -2> 2020-12-12 20:23:37.788 7f9598450c80 5 osd.11 pg_epoch: 120674 pg[19.cs1(unlocked)] enter Initial
  1657. -1> 2020-12-12 20:23:37.788 7f958b96e700 -1 /build/ceph/ceph-14.2.15/src/os/bluestore/BlueStore.cc: In function 'void BlueStore::_kv_sync_thread()' thread 7f958b96e700 time 2020-12-12 20:23:37.789990
  1658. /build/ceph/ceph-14.2.15/src/os/bluestore/BlueStore.cc: 11380: FAILED ceph_assert(r == 0)
  1659.  
  1660. ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable)
  1661. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x55a719568c1e]
  1662. 2: (()+0x513df6) [0x55a719568df6]
  1663. 3: (BlueStore::_kv_sync_thread()+0x1826) [0x55a719b01766]
  1664. 4: (BlueStore::KVSyncThread::entry()+0xd) [0x55a719b279bd]
  1665. 5: (()+0x7fa3) [0x7f9598e94fa3]
  1666. 6: (clone()+0x3f) [0x7f9598a444cf]
  1667.  
  1668. 0> 2020-12-12 20:23:37.788 7f958b96e700 -1 *** Caught signal (Aborted) **
  1669. in thread 7f958b96e700 thread_name:bstore_kv_sync
  1670.  
  1671. ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable)
  1672. 1: (()+0x12730) [0x7f9598e9f730]
  1673. 2: (gsignal()+0x10b) [0x7f95989827bb]
  1674. 3: (abort()+0x121) [0x7f959896d535]
  1675. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x55a719568c6f]
  1676. 5: (()+0x513df6) [0x55a719568df6]
  1677. 6: (BlueStore::_kv_sync_thread()+0x1826) [0x55a719b01766]
  1678. 7: (BlueStore::KVSyncThread::entry()+0xd) [0x55a719b279bd]
  1679. 8: (()+0x7fa3) [0x7f9598e94fa3]
  1680. 9: (clone()+0x3f) [0x7f9598a444cf]
  1681. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  1682.  
  1683. --- logging levels ---
  1684. 0/ 5 none
  1685. 0/ 1 lockdep
  1686. 0/ 1 context
  1687. 1/ 1 crush
  1688. 1/ 5 mds
  1689. 1/ 5 mds_balancer
  1690. 1/ 5 mds_locker
  1691. 1/ 5 mds_log
  1692. 1/ 5 mds_log_expire
  1693. 1/ 5 mds_migrator
  1694. 0/ 1 buffer
  1695. 0/ 1 timer
  1696. 0/ 1 filer
  1697. 0/ 1 striper
  1698. 0/ 1 objecter
  1699. 0/ 5 rados
  1700. 0/ 5 rbd
  1701. 0/ 5 rbd_mirror
  1702. 0/ 5 rbd_replay
  1703. 0/ 5 journaler
  1704. 0/ 5 objectcacher
  1705. 0/ 5 client
  1706. 1/ 5 osd
  1707. 0/ 5 optracker
  1708. 0/ 5 objclass
  1709. 1/ 3 filestore
  1710. 1/ 3 journal
  1711. 0/ 0 ms
  1712. 1/ 5 mon
  1713. 0/10 monc
  1714. 1/ 5 paxos
  1715. 0/ 5 tp
  1716. 1/ 5 auth
  1717. 1/ 5 crypto
  1718. 1/ 1 finisher
  1719. 1/ 1 reserver
  1720. 1/ 5 heartbeatmap
  1721. 1/ 5 perfcounter
  1722. 1/ 5 rgw
  1723. 1/ 5 rgw_sync
  1724. 1/10 civetweb
  1725. 1/ 5 javaclient
  1726. 1/ 5 asok
  1727. 1/ 1 throttle
  1728. 0/ 0 refs
  1729. 1/ 5 xio
  1730. 1/ 5 compressor
  1731. 1/ 5 bluestore
  1732. 1/ 5 bluefs
  1733. 1/ 3 bdev
  1734. 1/ 5 kstore
  1735. 4/ 5 rocksdb
  1736. 4/ 5 leveldb
  1737. 4/ 5 memdb
  1738. 1/ 5 kinetic
  1739. 1/ 5 fuse
  1740. 1/ 5 mgr
  1741. 1/ 5 mgrc
  1742. 1/ 5 dpdk
  1743. 1/ 5 eventtrace
  1744. 1/ 5 prioritycache
  1745. -2/-2 (syslog threshold)
  1746. -1/-1 (stderr threshold)
  1747. max_recent 10000
  1748. max_new 1000
  1749. log_file /var/log/ceph/ceph-osd.11.log
  1750. --- end dump of recent events ---
  1751. 2020-12-12 20:23:38.104 7fbe5bf07c80 0 set uid:gid to 64045:64045 (ceph:ceph)
  1752. 2020-12-12 20:23:38.104 7fbe5bf07c80 0 ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable), process ceph-osd, pid 797274
  1753. 2020-12-12 20:23:38.104 7fbe5bf07c80 0 pidfile_write: ignore empty --pid-file
  1754. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  1755. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  1756. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1757. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  1758. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  1759. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea6e00 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  1760. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea6e00 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1761. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  1762. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  1763. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea7180 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  1764. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea7180 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1765. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  1766. 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea6e00 /var/lib/ceph/osd/ceph-11/block.db) close
  1767. 2020-12-12 20:23:38.408 7fbe5bf07c80 1 bdev(0x561430ea7180 /var/lib/ceph/osd/ceph-11/block) close
  1768. 2020-12-12 20:23:38.652 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) close
  1769. 2020-12-12 20:23:38.904 7fbe5bf07c80 0 starting osd.11 osd_data /var/lib/ceph/osd/ceph-11 /var/lib/ceph/osd/ceph-11/journal
  1770. 2020-12-12 20:23:38.920 7fbe5bf07c80 0 load: jerasure load: lrc load: isa
  1771. 2020-12-12 20:23:38.920 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  1772. 2020-12-12 20:23:38.920 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  1773. 2020-12-12 20:23:38.920 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1774. 2020-12-12 20:23:38.920 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  1775. 2020-12-12 20:23:38.920 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) close
  1776. 2020-12-12 20:23:39.212 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _mount path /var/lib/ceph/osd/ceph-11
  1777. 2020-12-12 20:23:39.212 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  1778. 2020-12-12 20:23:39.212 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  1779. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1780. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  1781. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  1782. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev(0x561430ea7880 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  1783. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev(0x561430ea7880 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  1784. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  1785. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  1786. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev(0x561430ea7500 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  1787. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev(0x561430ea7500 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  1788. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  1789. 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option compaction_readahead_size = 2097152
  1790. 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option compression = kNoCompression
  1791. 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option max_background_compactions = 2
  1792. 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option max_write_buffer_number = 4
  1793. 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  1794. 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option recycle_log_file_num = 4
  1795. 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option writable_file_max_buffer_size = 0
  1796. 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option write_buffer_size = 268435456
  1797. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bluefs mount
  1798. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bluefs _init_alloc id 1 alloc_size 0x100000 size 0x14c8500000
  1799. 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bluefs _init_alloc id 2 alloc_size 0x10000 size 0x3a381400000
  1800. 2020-12-12 20:23:39.252 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db set db_paths to db,84797030400 db.slow,3800743857356
  1801. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option compaction_readahead_size = 2097152
  1802. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option compression = kNoCompression
  1803. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option max_background_compactions = 2
  1804. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option max_write_buffer_number = 4
  1805. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  1806. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option recycle_log_file_num = 4
  1807. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option writable_file_max_buffer_size = 0
  1808. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option write_buffer_size = 268435456
  1809. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option compaction_readahead_size = 2097152
  1810. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option compression = kNoCompression
  1811. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option max_background_compactions = 2
  1812. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option max_write_buffer_number = 4
  1813. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  1814. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option recycle_log_file_num = 4
  1815. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option writable_file_max_buffer_size = 0
  1816. 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option write_buffer_size = 268435456
  1817. 2020-12-12 20:23:39.252 7fbe5bf07c80 1 rocksdb: do_open column families: [default]
  1818. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: RocksDB version: 6.1.2
  1819.  
  1820. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  1821. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Compile date Dec 2 2020
  1822. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: DB SUMMARY
  1823.  
  1824. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: CURRENT file: CURRENT
  1825.  
  1826. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: IDENTITY file: IDENTITY
  1827.  
  1828. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: MANIFEST file: MANIFEST-003619 size: 6029 Bytes
  1829.  
  1830. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: SST files in db dir, Total Num: 47, files: 000199.sst 000264.sst 000265.sst 000340.sst 000341.sst 000342.sst 000343.sst 000345.sst 000346.sst
  1831.  
  1832. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
  1833.  
  1834. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Write Ahead Log file in db.wal: 003620.log size: 0 ;
  1835.  
  1836. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.error_if_exists: 0
  1837. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.create_if_missing: 0
  1838. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.paranoid_checks: 1
  1839. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.env: 0x561430f58e00
  1840. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.info_log: 0x561430f59820
  1841. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_file_opening_threads: 16
  1842. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.statistics: (nil)
  1843. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.use_fsync: 0
  1844. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_log_file_size: 0
  1845. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
  1846. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.log_file_time_to_roll: 0
  1847. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.keep_log_file_num: 1000
  1848. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.recycle_log_file_num: 4
  1849. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.allow_fallocate: 1
  1850. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.allow_mmap_reads: 0
  1851. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.allow_mmap_writes: 0
  1852. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.use_direct_reads: 0
  1853. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  1854. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.create_missing_column_families: 0
  1855. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.db_log_dir:
  1856. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.wal_dir: db.wal
  1857. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.table_cache_numshardbits: 6
  1858. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_subcompactions: 1
  1859. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_background_flushes: -1
  1860. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.WAL_ttl_seconds: 0
  1861. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.WAL_size_limit_MB: 0
  1862. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
  1863. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.is_fd_close_on_exec: 1
  1864. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.advise_random_on_open: 1
  1865. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.db_write_buffer_size: 0
  1866. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.write_buffer_manager: 0x561430e6acf0
  1867. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
  1868. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  1869. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  1870. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.use_adaptive_mutex: 0
  1871. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.rate_limiter: (nil)
  1872. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  1873. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.wal_recovery_mode: 0
  1874. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.enable_thread_tracking: 0
  1875. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.enable_pipelined_write: 0
  1876. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  1877. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  1878. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
  1879. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  1880. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.row_cache: None
  1881. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.wal_filter: None
  1882. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
  1883. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.allow_ingest_behind: 0
  1884. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.preserve_deletes: 0
  1885. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.two_write_queues: 0
  1886. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.manual_wal_flush: 0
  1887. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.atomic_flush: 0
  1888. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  1889. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_background_jobs: 2
  1890. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_background_compactions: 2
  1891. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  1892. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.writable_file_max_buffer_size: 0
  1893. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.delayed_write_rate : 16777216
  1894. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_total_wal_size: 0
  1895. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  1896. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.stats_dump_period_sec: 600
  1897. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.stats_persist_period_sec: 600
  1898. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
  1899. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_open_files: -1
  1900. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bytes_per_sync: 0
  1901. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.wal_bytes_per_sync: 0
  1902. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_readahead_size: 2097152
  1903. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Compression algorithms supported:
  1904. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
  1905. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kZSTD supported: 0
  1906. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kXpressCompression supported: 0
  1907. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kLZ4HCCompression supported: 1
  1908. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kLZ4Compression supported: 1
  1909. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kBZip2Compression supported: 0
  1910. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kZlibCompression supported: 1
  1911. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kSnappyCompression supported: 1
  1912. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Fast CRC32 supported: Supported on x86
  1913. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: [db/db_impl_readonly.cc:22] Opening the db in read only mode
  1914. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-003619
  1915.  
  1916. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  1917.  
  1918. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  1919. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  1920. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_filter: None
  1921. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_filter_factory: None
  1922. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.memtable_factory: SkipListFactory
  1923. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.table_factory: BlockBasedTable
  1924. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5614302ca248)
  1925. cache_index_and_filter_blocks: 1
  1926. cache_index_and_filter_blocks_with_high_priority: 1
  1927. pin_l0_filter_and_index_blocks_in_cache: 0
  1928. pin_top_level_index_and_filter: 1
  1929. index_type: 0
  1930. data_block_index_type: 0
  1931. data_block_hash_table_util_ratio: 0.750000
  1932. hash_index_allow_collision: 1
  1933. checksum: 1
  1934. no_block_cache: 0
  1935. block_cache: 0x561430218a10
  1936. block_cache_name: BinnedLRUCache
  1937. block_cache_options:
  1938. capacity : 429496729
  1939. num_shard_bits : 4
  1940. strict_capacity_limit : 0
  1941. high_pri_pool_ratio: 0.000
  1942. block_cache_compressed: (nil)
  1943. persistent_cache: (nil)
  1944. block_size: 4096
  1945. block_size_deviation: 10
  1946. block_restart_interval: 16
  1947. index_block_restart_interval: 1
  1948. metadata_block_size: 4096
  1949. partition_filters: 0
  1950. use_delta_encoding: 1
  1951. filter_policy: rocksdb.BuiltinBloomFilter
  1952. whole_key_filtering: 1
  1953. verify_compression: 0
  1954. read_amp_bytes_per_bit: 0
  1955. format_version: 2
  1956. enable_index_compression: 1
  1957. block_align: 0
  1958.  
  1959. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.write_buffer_size: 268435456
  1960. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_write_buffer_number: 4
  1961. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression: NoCompression
  1962. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression: Disabled
  1963. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.prefix_extractor: nullptr
  1964. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  1965. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.num_levels: 7
  1966. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  1967. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  1968. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  1969. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  1970. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  1971. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  1972. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  1973. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  1974. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression_opts.window_bits: -14
  1975. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression_opts.level: 32767
  1976. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression_opts.strategy: 0
  1977. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  1978. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  1979. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression_opts.enabled: false
  1980. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  1981. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  1982. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
  1983. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.target_file_size_base: 67108864
  1984. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.target_file_size_multiplier: 1
  1985. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  1986. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  1987. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  1988. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  1989. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  1990. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  1991. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  1992. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  1993. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  1994. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  1995. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  1996. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
  1997. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.arena_block_size: 33554432
  1998. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  1999. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  2000. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  2001. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.disable_auto_compactions: 0
  2002. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  2003. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  2004. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  2005. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  2006. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  2007. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  2008. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  2009. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  2010. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  2011. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  2012. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.table_properties_collectors:
  2013. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.inplace_update_support: 0
  2014. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.inplace_update_num_locks: 10000
  2015. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  2016. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
  2017. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.memtable_huge_page_size: 0
  2018. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bloom_locality: 0
  2019. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_successive_merges: 0
  2020. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.optimize_filters_for_hits: 0
  2021. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.paranoid_file_checks: 0
  2022. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.force_consistency_checks: 0
  2023. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.report_bg_io_stats: 0
  2024. 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.ttl: 0
  2025. 2020-12-12 20:23:39.256 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-003619 succeeded,manifest_file_number is 3619, next_file_number is 3621, last_sequence is 22382894, log_number is 3618,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  2026.  
  2027. 2020-12-12 20:23:39.256 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 3618
  2028.  
  2029. 2020-12-12 20:23:39.256 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019261216, "job": 1, "event": "recovery_started", "log_files": [3620]}
  2030. 2020-12-12 20:23:39.256 7fbe5bf07c80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3620 mode 0
  2031. 2020-12-12 20:23:39.256 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019261242, "job": 1, "event": "recovery_finished"}
  2032. 2020-12-12 20:23:39.256 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  2033. 2020-12-12 20:23:39.264 7fbe5bf07c80 1 freelist init
  2034. 2020-12-12 20:23:39.268 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_alloc opening allocation metadata
  2035. 2020-12-12 20:23:39.424 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_alloc loaded 2.3 TiB in 139875 extents available 2.2 TiB
  2036. 2020-12-12 20:23:39.424 7fbe5bf07c80 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work
  2037. 2020-12-12 20:23:39.424 7fbe5bf07c80 4 rocksdb: [db/db_impl.cc:563] Shutdown complete
  2038. 2020-12-12 20:23:39.424 7fbe5bf07c80 1 bluefs umount
  2039. 2020-12-12 20:23:39.424 7fbe5bf07c80 1 bdev(0x561430ea7880 /var/lib/ceph/osd/ceph-11/block.db) close
  2040. 2020-12-12 20:23:39.500 7fbe5bf07c80 1 bdev(0x561430ea7500 /var/lib/ceph/osd/ceph-11/block) close
  2041. 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  2042. 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bdev(0x561430ea7500 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  2043. 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bdev(0x561430ea7500 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2044. 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  2045. 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  2046. 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bdev(0x561430ea7880 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  2047. 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bdev(0x561430ea7880 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2048. 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  2049. 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option compaction_readahead_size = 2097152
  2050. 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option compression = kNoCompression
  2051. 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option max_background_compactions = 2
  2052. 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option max_write_buffer_number = 4
  2053. 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  2054. 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option recycle_log_file_num = 4
  2055. 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option writable_file_max_buffer_size = 0
  2056. 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option write_buffer_size = 268435456
  2057. 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bluefs mount
  2058. 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bluefs _init_alloc id 1 alloc_size 0x100000 size 0x14c8500000
  2059. 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bluefs _init_alloc id 2 alloc_size 0x10000 size 0x3a381400000
  2060. 2020-12-12 20:23:39.792 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db set db_paths to db,84797030400 db.slow,3800743857356
  2061. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option compaction_readahead_size = 2097152
  2062. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option compression = kNoCompression
  2063. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option max_background_compactions = 2
  2064. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option max_write_buffer_number = 4
  2065. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  2066. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option recycle_log_file_num = 4
  2067. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option writable_file_max_buffer_size = 0
  2068. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option write_buffer_size = 268435456
  2069. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option compaction_readahead_size = 2097152
  2070. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option compression = kNoCompression
  2071. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option max_background_compactions = 2
  2072. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option max_write_buffer_number = 4
  2073. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  2074. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option recycle_log_file_num = 4
  2075. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option writable_file_max_buffer_size = 0
  2076. 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option write_buffer_size = 268435456
  2077. 2020-12-12 20:23:39.792 7fbe5bf07c80 1 rocksdb: do_open column families: [default]
  2078. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: RocksDB version: 6.1.2
  2079.  
  2080. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  2081. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Compile date Dec 2 2020
  2082. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: DB SUMMARY
  2083.  
  2084. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: CURRENT file: CURRENT
  2085.  
  2086. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: IDENTITY file: IDENTITY
  2087.  
  2088. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: MANIFEST file: MANIFEST-003619 size: 6029 Bytes
  2089.  
  2090. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: SST files in db dir, Total Num: 47, files: 000199.sst 000264.sst 000265.sst 000340.sst 000341.sst 000342.sst 000343.sst 000345.sst 000346.sst
  2091.  
  2092. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
  2093.  
  2094. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Write Ahead Log file in db.wal: 003620.log size: 0 ;
  2095.  
  2096. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.error_if_exists: 0
  2097. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.create_if_missing: 0
  2098. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.paranoid_checks: 1
  2099. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.env: 0x561431950d20
  2100. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.info_log: 0x5614319503c0
  2101. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_file_opening_threads: 16
  2102. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.statistics: (nil)
  2103. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.use_fsync: 0
  2104. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_log_file_size: 0
  2105. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
  2106. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.log_file_time_to_roll: 0
  2107. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.keep_log_file_num: 1000
  2108. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.recycle_log_file_num: 4
  2109. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.allow_fallocate: 1
  2110. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.allow_mmap_reads: 0
  2111. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.allow_mmap_writes: 0
  2112. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.use_direct_reads: 0
  2113. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  2114. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.create_missing_column_families: 0
  2115. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.db_log_dir:
  2116. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.wal_dir: db.wal
  2117. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.table_cache_numshardbits: 6
  2118. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_subcompactions: 1
  2119. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_background_flushes: -1
  2120. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.WAL_ttl_seconds: 0
  2121. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.WAL_size_limit_MB: 0
  2122. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
  2123. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.is_fd_close_on_exec: 1
  2124. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.advise_random_on_open: 1
  2125. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.db_write_buffer_size: 0
  2126. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.write_buffer_manager: 0x5614311f4000
  2127. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
  2128. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  2129. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  2130. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.use_adaptive_mutex: 0
  2131. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.rate_limiter: (nil)
  2132. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  2133. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.wal_recovery_mode: 0
  2134. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.enable_thread_tracking: 0
  2135. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.enable_pipelined_write: 0
  2136. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  2137. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  2138. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
  2139. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  2140. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.row_cache: None
  2141. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.wal_filter: None
  2142. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
  2143. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.allow_ingest_behind: 0
  2144. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.preserve_deletes: 0
  2145. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.two_write_queues: 0
  2146. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.manual_wal_flush: 0
  2147. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.atomic_flush: 0
  2148. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  2149. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_background_jobs: 2
  2150. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_background_compactions: 2
  2151. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  2152. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.writable_file_max_buffer_size: 0
  2153. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.delayed_write_rate : 16777216
  2154. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_total_wal_size: 0
  2155. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  2156. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.stats_dump_period_sec: 600
  2157. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.stats_persist_period_sec: 600
  2158. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
  2159. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_open_files: -1
  2160. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bytes_per_sync: 0
  2161. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.wal_bytes_per_sync: 0
  2162. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_readahead_size: 2097152
  2163. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Compression algorithms supported:
  2164. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
  2165. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kZSTD supported: 0
  2166. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kXpressCompression supported: 0
  2167. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kLZ4HCCompression supported: 1
  2168. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kLZ4Compression supported: 1
  2169. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kBZip2Compression supported: 0
  2170. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kZlibCompression supported: 1
  2171. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kSnappyCompression supported: 1
  2172. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Fast CRC32 supported: Supported on x86
  2173. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-003619
  2174.  
  2175. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  2176.  
  2177. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  2178. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  2179. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_filter: None
  2180. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_filter_factory: None
  2181. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.memtable_factory: SkipListFactory
  2182. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.table_factory: BlockBasedTable
  2183. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5614302ca240)
  2184. cache_index_and_filter_blocks: 1
  2185. cache_index_and_filter_blocks_with_high_priority: 1
  2186. pin_l0_filter_and_index_blocks_in_cache: 0
  2187. pin_top_level_index_and_filter: 1
  2188. index_type: 0
  2189. data_block_index_type: 0
  2190. data_block_hash_table_util_ratio: 0.750000
  2191. hash_index_allow_collision: 1
  2192. checksum: 1
  2193. no_block_cache: 0
  2194. block_cache: 0x561430218910
  2195. block_cache_name: BinnedLRUCache
  2196. block_cache_options:
  2197. capacity : 429496729
  2198. num_shard_bits : 4
  2199. strict_capacity_limit : 0
  2200. high_pri_pool_ratio: 0.000
  2201. block_cache_compressed: (nil)
  2202. persistent_cache: (nil)
  2203. block_size: 4096
  2204. block_size_deviation: 10
  2205. block_restart_interval: 16
  2206. index_block_restart_interval: 1
  2207. metadata_block_size: 4096
  2208. partition_filters: 0
  2209. use_delta_encoding: 1
  2210. filter_policy: rocksdb.BuiltinBloomFilter
  2211. whole_key_filtering: 1
  2212. verify_compression: 0
  2213. read_amp_bytes_per_bit: 0
  2214. format_version: 2
  2215. enable_index_compression: 1
  2216. block_align: 0
  2217.  
  2218. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.write_buffer_size: 268435456
  2219. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_write_buffer_number: 4
  2220. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression: NoCompression
  2221. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression: Disabled
  2222. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.prefix_extractor: nullptr
  2223. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  2224. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.num_levels: 7
  2225. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  2226. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  2227. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  2228. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  2229. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  2230. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  2231. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  2232. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  2233. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression_opts.window_bits: -14
  2234. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression_opts.level: 32767
  2235. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression_opts.strategy: 0
  2236. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  2237. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  2238. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression_opts.enabled: false
  2239. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  2240. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  2241. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
  2242. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.target_file_size_base: 67108864
  2243. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.target_file_size_multiplier: 1
  2244. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  2245. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  2246. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  2247. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  2248. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  2249. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  2250. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  2251. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  2252. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  2253. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  2254. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  2255. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
  2256. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.arena_block_size: 33554432
  2257. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  2258. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  2259. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  2260. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.disable_auto_compactions: 0
  2261. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  2262. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  2263. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  2264. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  2265. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  2266. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  2267. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  2268. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  2269. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  2270. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  2271. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.table_properties_collectors:
  2272. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.inplace_update_support: 0
  2273. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.inplace_update_num_locks: 10000
  2274. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  2275. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
  2276. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.memtable_huge_page_size: 0
  2277. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bloom_locality: 0
  2278. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_successive_merges: 0
  2279. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.optimize_filters_for_hits: 0
  2280. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.paranoid_file_checks: 0
  2281. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.force_consistency_checks: 0
  2282. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.report_bg_io_stats: 0
  2283. 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.ttl: 0
  2284. 2020-12-12 20:23:39.796 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-003619 succeeded,manifest_file_number is 3619, next_file_number is 3621, last_sequence is 22382894, log_number is 3618,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  2285.  
  2286. 2020-12-12 20:23:39.796 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 3618
  2287.  
  2288. 2020-12-12 20:23:39.796 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019801442, "job": 1, "event": "recovery_started", "log_files": [3620]}
  2289. 2020-12-12 20:23:39.796 7fbe5bf07c80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3620 mode 0
  2290. 2020-12-12 20:23:39.796 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3036] Creating manifest 3622
  2291.  
  2292. 2020-12-12 20:23:39.800 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019804425, "job": 1, "event": "recovery_finished"}
  2293. 2020-12-12 20:23:39.800 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019804501, "job": 2, "event": "table_file_deletion", "file_number": 3626}
  2294. 2020-12-12 20:23:39.800 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019804515, "job": 2, "event": "table_file_deletion", "file_number": 3625}
  2295. 2020-12-12 20:23:39.800 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019804522, "job": 2, "event": "table_file_deletion", "file_number": 3624}
  2296. 2020-12-12 20:23:39.800 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019804528, "job": 2, "event": "table_file_deletion", "file_number": 3623}
  2297. 2020-12-12 20:23:39.804 7fbe5bf07c80 4 rocksdb: DB pointer 0x561431d54000
  2298. 2020-12-12 20:23:39.804 7fbe50c28700 4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 3] Compacting 1@1 + 4@2 files to L2, score 1.03
  2299. 2020-12-12 20:23:39.804 7fbe50c28700 4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 2 Base level 1, inputs: [449(64MB)], [345(64MB) 346(64MB) 347(64MB) 348(64MB)]
  2300.  
  2301. 2020-12-12 20:23:39.804 7fbe50c28700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019807415, "job": 3, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [449], "files_L2": [345, 346, 347, 348], "score": 1.02872, "input_data_size": 338693918}
  2302. 2020-12-12 20:23:39.804 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  2303. 2020-12-12 20:23:39.804 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _upgrade_super from 2, latest 2
  2304. 2020-12-12 20:23:39.804 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _upgrade_super done
  2305. 2020-12-12 20:23:39.804 7fbe48417700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS -------
  2306. 2020-12-12 20:23:39.804 7fbe48417700 4 rocksdb: [db/db_impl.cc:778]
  2307. ** DB Stats **
  2308. Uptime(secs): 0.0 total, 0.0 interval
  2309. Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
  2310. Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
  2311. Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
  2312. Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
  2313. Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
  2314. Interval stall: 00:00:0.000 H:M:S, 0.0 percent
  2315.  
  2316. ** Compaction Stats [default] **
  2317. Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  2318. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  2319. L0 2/0 3.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  2320. L1 4/1 194.65 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  2321. L2 37/4 2.22 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  2322. Sum 43/5 2.41 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  2323. Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  2324.  
  2325. ** Compaction Stats [default] **
  2326. Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  2327. -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  2328. Uptime(secs): 0.0 total, 0.0 interval
  2329. Flush(GB): cumulative 0.000, interval 0.000
  2330. AddFile(GB): cumulative 0.000, interval 0.000
  2331. AddFile(Total Files): cumulative 0, interval 0
  2332. AddFile(L0 Files): cumulative 0, interval 0
  2333. AddFile(Keys): cumulative 0, interval 0
  2334. Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  2335. Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  2336. Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
  2337.  
  2338. ** File Read Latency Histogram By Level [default] **
  2339.  
  2340. ** Compaction Stats [default] **
  2341. Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  2342. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  2343. L0 2/0 3.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  2344. L1 4/1 194.65 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  2345. L2 37/4 2.22 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  2346. Sum 43/5 2.41 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  2347. Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  2348.  
  2349. ** Compaction Stats [default] **
  2350. Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  2351. -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  2352. Uptime(secs): 0.0 total, 0.0 interval
  2353. Flush(GB): cumulative 0.000, interval 0.000
  2354. AddFile(GB): cumulative 0.000, interval 0.000
  2355. AddFile(Total Files): cumulative 0, interval 0
  2356. AddFile(L0 Files): cumulative 0, interval 0
  2357. AddFile(Keys): cumulative 0, interval 0
  2358. Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  2359. Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  2360. Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
  2361.  
  2362. ** File Read Latency Histogram By Level [default] **
  2363.  
  2364. 2020-12-12 20:23:39.852 7fbe5bf07c80 0 _get_class not permitted to load sdk
  2365. 2020-12-12 20:23:39.852 7fbe5bf07c80 0 <cls> /build/ceph/ceph-14.2.15/src/cls/hello/cls_hello.cc:296: loading cls_hello
  2366. 2020-12-12 20:23:39.852 7fbe5bf07c80 0 _get_class not permitted to load lua
  2367. 2020-12-12 20:23:39.860 7fbe5bf07c80 0 _get_class not permitted to load kvs
  2368. 2020-12-12 20:23:39.860 7fbe5bf07c80 0 <cls> /build/ceph/ceph-14.2.15/src/cls/cephfs/cls_cephfs.cc:197: loading cephfs
  2369. 2020-12-12 20:23:39.860 7fbe5bf07c80 0 osd.11 120674 crush map has features 432629308056666112, adjusting msgr requires for clients
  2370. 2020-12-12 20:23:39.860 7fbe5bf07c80 0 osd.11 120674 crush map has features 432629308056666112 was 8705, adjusting msgr requires for mons
  2371. 2020-12-12 20:23:39.860 7fbe5bf07c80 0 osd.11 120674 crush map has features 3314933069573799936, adjusting msgr requires for osds
  2372. 2020-12-12 20:23:40.244 7fbe50c28700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3626: 42754 keys, 67717992 bytes
  2373. 2020-12-12 20:23:40.244 7fbe50c28700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837020248383, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3626, "file_size": 67717992, "table_properties": {"data_size": 67112720, "index_size": 497464, "filter_size": 106949, "raw_key_size": 2795150, "raw_average_key_size": 65, "raw_value_size": 64371790, "raw_average_value_size": 1505, "num_data_blocks": 14079, "num_entries": 42754, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  2374. 2020-12-12 20:23:40.640 7fbe50c28700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3627: 43658 keys, 67732235 bytes
  2375. 2020-12-12 20:23:40.640 7fbe50c28700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837020643165, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3627, "file_size": 67732235, "table_properties": {"data_size": 67111811, "index_size": 510312, "filter_size": 109253, "raw_key_size": 3756526, "raw_average_key_size": 86, "raw_value_size": 63462002, "raw_average_value_size": 1453, "num_data_blocks": 14230, "num_entries": 43658, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  2376. 2020-12-12 20:23:41.024 7fbe50c28700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3628: 43657 keys, 67729297 bytes
  2377. 2020-12-12 20:23:41.024 7fbe50c28700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837021027524, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3628, "file_size": 67729297, "table_properties": {"data_size": 67113092, "index_size": 506093, "filter_size": 109253, "raw_key_size": 3372528, "raw_average_key_size": 77, "raw_value_size": 63853503, "raw_average_value_size": 1462, "num_data_blocks": 14172, "num_entries": 43657, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  2378. 2020-12-12 20:23:41.400 7fbe50c28700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3629: 42522 keys, 67713983 bytes
  2379. 2020-12-12 20:23:41.400 7fbe50c28700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837021404072, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3629, "file_size": 67713983, "table_properties": {"data_size": 67112021, "index_size": 494666, "filter_size": 106437, "raw_key_size": 2680741, "raw_average_key_size": 63, "raw_value_size": 64464845, "raw_average_value_size": 1516, "num_data_blocks": 14067, "num_entries": 42522, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  2380. 2020-12-12 20:23:41.544 7fbe5bf07c80 0 osd.11 120674 load_pgs
  2381. 2020-12-12 20:23:41.688 7fbe50c28700 3 rocksdb: [db/db_impl_compaction_flush.cc:2660] Compaction error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704
  2382. 2020-12-12 20:23:41.688 7fbe50c28700 4 rocksdb: (Original Log Time 2020/12/12-20:23:41.693356) [db/compaction_job.cc:768] [default] compacted to: files[2 4 37 0 0 0 0] max score 0.79, MB/sec: 179.6 rd, 143.6 wr, level 2, files in(1, 4) out(5) MB in(64.7, 258.3) out(258.3), read-write-amplify(9.0) write-amplify(4.0) Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704, records in: 243696, records dropped: 28515 output_compression: NoCompression
  2383.  
  2384. 2020-12-12 20:23:41.688 7fbe50c28700 4 rocksdb: (Original Log Time 2020/12/12-20:23:41.693410) EVENT_LOG_v1 {"time_micros": 1607837021693385, "job": 3, "event": "compaction_finished", "compaction_time_micros": 1885886, "compaction_time_cpu_micros": 452394, "output_level": 2, "num_output_files": 5, "total_output_size": 318240797, "num_input_records": 231169, "num_output_records": 202654, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [2, 4, 37, 0, 0, 0, 0]}
  2385. 2020-12-12 20:23:41.688 7fbe50c28700 2 rocksdb: [db/db_impl_compaction_flush.cc:2212] Waiting after background compaction error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704, Accumulated background error counts: 1
  2386. 2020-12-12 20:23:41.764 7fbe4f425700 -1 rocksdb: submit_common error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704 code = 2 Rocksdb transaction:
  2387. Put( Prefix = P key = 0x000000000000146e'.can_rollback_to' Value size = 12)
  2388. Put( Prefix = P key = 0x000000000000146e'.rollback_info_trimmed_to' Value size = 12)
  2389. Put( Prefix = O key = 0x828000000000000013f000000021213dfffffffffffffffeffffffffffffffff'o' Value size = 29)
  2390. Put( Prefix = S key = 'nid_max' Value size = 8)
  2391. Put( Prefix = S key = 'blobid_max' Value size = 8)
  2392. 2020-12-12 20:23:41.768 7fbe4f425700 -1 /build/ceph/ceph-14.2.15/src/os/bluestore/BlueStore.cc: In function 'void BlueStore::_kv_sync_thread()' thread 7fbe4f425700 time 2020-12-12 20:23:41.768820
  2393. /build/ceph/ceph-14.2.15/src/os/bluestore/BlueStore.cc: 11380: FAILED ceph_assert(r == 0)
  2394.  
  2395. ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable)
  2396. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x5614258c5c1e]
  2397. 2: (()+0x513df6) [0x5614258c5df6]
  2398. 3: (BlueStore::_kv_sync_thread()+0x1826) [0x561425e5e766]
  2399. 4: (BlueStore::KVSyncThread::entry()+0xd) [0x561425e849bd]
  2400. 5: (()+0x7fa3) [0x7fbe5c94bfa3]
  2401. 6: (clone()+0x3f) [0x7fbe5c4fb4cf]
  2402.  
  2403. 2020-12-12 20:23:41.768 7fbe4f425700 -1 *** Caught signal (Aborted) **
  2404. in thread 7fbe4f425700 thread_name:bstore_kv_sync
  2405.  
  2406. ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable)
  2407. 1: (()+0x12730) [0x7fbe5c956730]
  2408. 2: (gsignal()+0x10b) [0x7fbe5c4397bb]
  2409. 3: (abort()+0x121) [0x7fbe5c424535]
  2410. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x5614258c5c6f]
  2411. 5: (()+0x513df6) [0x5614258c5df6]
  2412. 6: (BlueStore::_kv_sync_thread()+0x1826) [0x561425e5e766]
  2413. 7: (BlueStore::KVSyncThread::entry()+0xd) [0x561425e849bd]
  2414. 8: (()+0x7fa3) [0x7fbe5c94bfa3]
  2415. 9: (clone()+0x3f) [0x7fbe5c4fb4cf]
  2416. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  2417.  
  2418. --- begin dump of recent events ---
  2419. -763> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command assert hook 0x5614301d0110
  2420. -762> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command abort hook 0x5614301d0110
  2421. -761> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command perfcounters_dump hook 0x5614301d0110
  2422. -760> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command 1 hook 0x5614301d0110
  2423. -759> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command perf dump hook 0x5614301d0110
  2424. -758> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command perfcounters_schema hook 0x5614301d0110
  2425. -757> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command perf histogram dump hook 0x5614301d0110
  2426. -756> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command 2 hook 0x5614301d0110
  2427. -755> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command perf schema hook 0x5614301d0110
  2428. -754> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command perf histogram schema hook 0x5614301d0110
  2429. -753> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command perf reset hook 0x5614301d0110
  2430. -752> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command config show hook 0x5614301d0110
  2431. -751> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command config help hook 0x5614301d0110
  2432. -750> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command config set hook 0x5614301d0110
  2433. -749> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command config unset hook 0x5614301d0110
  2434. -748> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command config get hook 0x5614301d0110
  2435. -747> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command config diff hook 0x5614301d0110
  2436. -746> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command config diff get hook 0x5614301d0110
  2437. -745> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command log flush hook 0x5614301d0110
  2438. -744> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command log dump hook 0x5614301d0110
  2439. -743> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command log reopen hook 0x5614301d0110
  2440. -742> 2020-12-12 20:23:38.096 7fbe5bf07c80 5 asok(0x56143026e000) register_command dump_mempools hook 0x561430e6c068
  2441. -741> 2020-12-12 20:23:38.100 7fbe5bf07c80 10 monclient: get_monmap_and_config
  2442. -740> 2020-12-12 20:23:38.104 7fbe5bf07c80 10 monclient: build_initial_monmap
  2443. -739> 2020-12-12 20:23:38.104 7fbe5bf07c80 10 monclient: monmap:
  2444. epoch 0
  2445. fsid d0b4c175-02ba-4a64-8040-eb163002cba6
  2446. last_changed 2020-12-12 20:23:38.105964
  2447. created 2020-12-12 20:23:38.105964
  2448. min_mon_release 0 (unknown)
  2449. 0: v1:192.168.8.100:6789/0 mon.noname-a-legacy
  2450. 1: v1:192.168.8.101:6789/0 mon.noname-c-legacy
  2451. 2: v1:192.168.8.102:6789/0 mon.noname-b-legacy
  2452. 3: v2:192.168.8.100:3300/0 mon.noname-a
  2453. 4: v2:192.168.8.101:3300/0 mon.noname-c
  2454. 5: v2:192.168.8.102:3300/0 mon.noname-b
  2455.  
  2456. -738> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding auth protocol: cephx
  2457. -737> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding auth protocol: cephx
  2458. -736> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding auth protocol: cephx
  2459. -735> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: secure
  2460. -734> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: crc
  2461. -733> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: secure
  2462. -732> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: crc
  2463. -731> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: secure
  2464. -730> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: crc
  2465. -729> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: crc
  2466. -728> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: secure
  2467. -727> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: crc
  2468. -726> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: secure
  2469. -725> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: crc
  2470. -724> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: secure
  2471. -723> 2020-12-12 20:23:38.104 7fbe5bf07c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  2472. -722> 2020-12-12 20:23:38.104 7fbe5bf07c80 10 monclient: init
  2473. -721> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding auth protocol: cephx
  2474. -720> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding auth protocol: cephx
  2475. -719> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding auth protocol: cephx
  2476. -718> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding con mode: secure
  2477. -717> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding con mode: crc
  2478. -716> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding con mode: secure
  2479. -715> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding con mode: crc
  2480. -714> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding con mode: secure
  2481. -713> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding con mode: crc
  2482. -712> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding con mode: crc
  2483. -711> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding con mode: secure
  2484. -710> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding con mode: crc
  2485. -709> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding con mode: secure
  2486. -708> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding con mode: crc
  2487. -707> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 AuthRegistry(0x7ffd8fb1e2b8) adding con mode: secure
  2488. -706> 2020-12-12 20:23:38.104 7fbe5bf07c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  2489. -705> 2020-12-12 20:23:38.104 7fbe5bf07c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  2490. -704> 2020-12-12 20:23:38.104 7fbe5bf07c80 10 monclient: _reopen_session rank -1
  2491. -703> 2020-12-12 20:23:38.104 7fbe5bf07c80 10 monclient(hunting): picked mon.noname-b con 0x561430267b00 addr v2:192.168.8.102:3300/0
  2492. -702> 2020-12-12 20:23:38.104 7fbe5bf07c80 10 monclient(hunting): picked mon.noname-a-legacy con 0x561430267f80 addr v1:192.168.8.100:6789/0
  2493. -701> 2020-12-12 20:23:38.104 7fbe5bf07c80 10 monclient(hunting): picked mon.noname-b-legacy con 0x561430268400 addr v1:192.168.8.102:6789/0
  2494. -700> 2020-12-12 20:23:38.104 7fbe5bf07c80 10 monclient(hunting): start opening mon connection
  2495. -699> 2020-12-12 20:23:38.104 7fbe5bf07c80 10 monclient(hunting): _renew_subs
  2496. -698> 2020-12-12 20:23:38.104 7fbe5bf07c80 10 monclient(hunting): authenticate will time out at 2020-12-12 20:28:38.106807
  2497. -697> 2020-12-12 20:23:38.104 7fbe5b4cd700 10 monclient(hunting): get_auth_request con 0x561430267b00 auth_method 0
  2498. -696> 2020-12-12 20:23:38.104 7fbe5b4cd700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2]
  2499. -695> 2020-12-12 20:23:38.104 7fbe5b4cd700 10 monclient(hunting): _init_auth method 2
  2500. -694> 2020-12-12 20:23:38.104 7fbe5b4cd700 10 monclient(hunting): handle_auth_reply_more payload 9
  2501. -693> 2020-12-12 20:23:38.104 7fbe5b4cd700 10 monclient(hunting): handle_auth_reply_more payload_len 9
  2502. -692> 2020-12-12 20:23:38.104 7fbe5b4cd700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
  2503. -691> 2020-12-12 20:23:38.104 7fbe5b4cd700 10 monclient(hunting): handle_auth_done global_id 93709093 payload 386
  2504. -690> 2020-12-12 20:23:38.104 7fbe5b4cd700 10 monclient: _finish_hunting 0
  2505. -689> 2020-12-12 20:23:38.104 7fbe5b4cd700 1 monclient: found mon.noname-b
  2506. -688> 2020-12-12 20:23:38.104 7fbe5b4cd700 10 monclient: _send_mon_message to mon.noname-b at v2:192.168.8.102:3300/0
  2507. -687> 2020-12-12 20:23:38.104 7fbe5a4cb700 10 monclient: handle_monmap mon_map magic: 0 v1
  2508. -686> 2020-12-12 20:23:38.104 7fbe5a4cb700 10 monclient: got monmap 11 from mon.noname-b (according to old e11)
  2509. -685> 2020-12-12 20:23:38.104 7fbe5a4cb700 10 monclient: dump:
  2510. epoch 11
  2511. fsid d0b4c175-02ba-4a64-8040-eb163002cba6
  2512. last_changed 2020-12-05 09:42:18.637201
  2513. created 2020-04-05 17:40:47.148501
  2514. min_mon_release 14 (nautilus)
  2515. 0: [v2:192.168.8.100:3300/0,v1:192.168.8.100:6789/0] mon.sumib
  2516. 1: [v2:192.168.8.102:3300/0,v1:192.168.8.102:6789/0] mon.tower1
  2517. 2: [v2:192.168.8.101:3300/0,v1:192.168.8.101:6789/0] mon.sumia
  2518.  
  2519. -684> 2020-12-12 20:23:38.104 7fbe5a4cb700 10 monclient: _finish_auth 0
  2520. -683> 2020-12-12 20:23:38.104 7fbe5a4cb700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2020-12-12 20:23:08.107468)
  2521. -682> 2020-12-12 20:23:38.104 7fbe5a4cb700 10 monclient: _send_mon_message to mon.tower1 at v2:192.168.8.102:3300/0
  2522. -681> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 monclient: authenticate success, global_id 93709093
  2523. -680> 2020-12-12 20:23:38.104 7fbe5a4cb700 10 monclient: handle_config config(9 keys) v1
  2524. -679> 2020-12-12 20:23:38.104 7fbe5bf07c80 10 monclient: get_monmap_and_config success
  2525. -678> 2020-12-12 20:23:38.104 7fbe5bf07c80 10 monclient: shutdown
  2526. -677> 2020-12-12 20:23:38.104 7fbe5a4cb700 10 monclient: handle_monmap mon_map magic: 0 v1
  2527. -676> 2020-12-12 20:23:38.104 7fbe5a4cb700 10 monclient: got monmap 11 from mon.tower1 (according to old e11)
  2528. -675> 2020-12-12 20:23:38.104 7fbe58cc8700 4 set_mon_vals no callback set
  2529. -674> 2020-12-12 20:23:38.104 7fbe5a4cb700 10 monclient: dump:
  2530. epoch 11
  2531. fsid d0b4c175-02ba-4a64-8040-eb163002cba6
  2532. last_changed 2020-12-05 09:42:18.637201
  2533. created 2020-04-05 17:40:47.148501
  2534. min_mon_release 14 (nautilus)
  2535. 0: [v2:192.168.8.100:3300/0,v1:192.168.8.100:6789/0] mon.sumib
  2536. 1: [v2:192.168.8.102:3300/0,v1:192.168.8.102:6789/0] mon.tower1
  2537. 2: [v2:192.168.8.101:3300/0,v1:192.168.8.101:6789/0] mon.sumia
  2538.  
  2539. -673> 2020-12-12 20:23:38.104 7fbe58cc8700 10 set_mon_vals device_failure_prediction_mode = none
  2540. -672> 2020-12-12 20:23:38.104 7fbe58cc8700 10 set_mon_vals mon_max_pg_per_osd = 272
  2541. -671> 2020-12-12 20:23:38.104 7fbe58cc8700 10 set_mon_vals mon_target_pg_per_osd = 100
  2542. -670> 2020-12-12 20:23:38.104 7fbe58cc8700 10 set_mon_vals osd_pool_default_pg_autoscale_mode = on
  2543. -669> 2020-12-12 20:23:38.104 7fbe58cc8700 10 set_mon_vals osd_recovery_max_active = 3
  2544. -668> 2020-12-12 20:23:38.104 7fbe58cc8700 10 set_mon_vals osd_recovery_max_single_start = 1
  2545. -667> 2020-12-12 20:23:38.104 7fbe58cc8700 10 set_mon_vals osd_recovery_sleep = 0.000000
  2546. -666> 2020-12-12 20:23:38.104 7fbe58cc8700 10 set_mon_vals osd_scrub_auto_repair = true
  2547. -665> 2020-12-12 20:23:38.104 7fbe5bf07c80 0 set uid:gid to 64045:64045 (ceph:ceph)
  2548. -664> 2020-12-12 20:23:38.104 7fbe5bf07c80 0 ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable), process ceph-osd, pid 797274
  2549. -663> 2020-12-12 20:23:38.104 7fbe5bf07c80 0 pidfile_write: ignore empty --pid-file
  2550. -662> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 asok(0x56143026e000) init /var/run/ceph/ceph-osd.11.asok
  2551. -661> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 asok(0x56143026e000) bind_and_listen /var/run/ceph/ceph-osd.11.asok
  2552. -660> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 asok(0x56143026e000) register_command 0 hook 0x5614301cf8d0
  2553. -659> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 asok(0x56143026e000) register_command version hook 0x5614301cf8d0
  2554. -658> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 asok(0x56143026e000) register_command git_version hook 0x5614301cf8d0
  2555. -657> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 asok(0x56143026e000) register_command help hook 0x5614301d0180
  2556. -656> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 asok(0x56143026e000) register_command get_command_descriptions hook 0x5614301d01d0
  2557. -655> 2020-12-12 20:23:38.104 7fbe594c9700 5 asok(0x56143026e000) entry start
  2558. -654> 2020-12-12 20:23:38.104 7fbe5bf07c80 5 object store type is bluestore
  2559. -653> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  2560. -652> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  2561. -651> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2562. -650> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  2563. -649> 2020-12-12 20:23:38.108 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore bluefs available hook 0x5614301d0760
  2564. -648> 2020-12-12 20:23:38.108 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore bluefs stats hook 0x5614301d0760
  2565. -647> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  2566. -646> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea6e00 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  2567. -645> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea6e00 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2568. -644> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  2569. -643> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  2570. -642> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea7180 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  2571. -641> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea7180 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2572. -640> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  2573. -639> 2020-12-12 20:23:38.108 7fbe5bf07c80 5 asok(0x56143026e000) unregister_commands bluestore bluefs available
  2574. -638> 2020-12-12 20:23:38.108 7fbe5bf07c80 5 asok(0x56143026e000) unregister_commands bluestore bluefs stats
  2575. -637> 2020-12-12 20:23:38.108 7fbe5bf07c80 1 bdev(0x561430ea6e00 /var/lib/ceph/osd/ceph-11/block.db) close
  2576. -636> 2020-12-12 20:23:38.408 7fbe5bf07c80 1 bdev(0x561430ea7180 /var/lib/ceph/osd/ceph-11/block) close
  2577. -635> 2020-12-12 20:23:38.652 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) close
  2578. -634> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding auth protocol: cephx
  2579. -633> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding auth protocol: cephx
  2580. -632> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding auth protocol: cephx
  2581. -631> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: secure
  2582. -630> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: crc
  2583. -629> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: secure
  2584. -628> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: crc
  2585. -627> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: secure
  2586. -626> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: crc
  2587. -625> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: crc
  2588. -624> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: secure
  2589. -623> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: crc
  2590. -622> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: secure
  2591. -621> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: crc
  2592. -620> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4a140) adding con mode: secure
  2593. -619> 2020-12-12 20:23:38.904 7fbe5bf07c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  2594. -618> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding auth protocol: cephx
  2595. -617> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding auth protocol: cephx
  2596. -616> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding auth protocol: cephx
  2597. -615> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding con mode: secure
  2598. -614> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding con mode: crc
  2599. -613> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding con mode: secure
  2600. -612> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding con mode: crc
  2601. -611> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding con mode: secure
  2602. -610> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding con mode: crc
  2603. -609> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding con mode: crc
  2604. -608> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding con mode: secure
  2605. -607> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding con mode: crc
  2606. -606> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding con mode: secure
  2607. -605> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding con mode: crc
  2608. -604> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4aa40) adding con mode: secure
  2609. -603> 2020-12-12 20:23:38.904 7fbe5bf07c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  2610. -602> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding auth protocol: cephx
  2611. -601> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding auth protocol: cephx
  2612. -600> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding auth protocol: cephx
  2613. -599> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding con mode: secure
  2614. -598> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding con mode: crc
  2615. -597> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding con mode: secure
  2616. -596> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding con mode: crc
  2617. -595> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding con mode: secure
  2618. -594> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding con mode: crc
  2619. -593> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding con mode: crc
  2620. -592> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding con mode: secure
  2621. -591> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding con mode: crc
  2622. -590> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding con mode: secure
  2623. -589> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding con mode: crc
  2624. -588> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4b340) adding con mode: secure
  2625. -587> 2020-12-12 20:23:38.904 7fbe5bf07c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  2626. -586> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding auth protocol: cephx
  2627. -585> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding auth protocol: cephx
  2628. -584> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding auth protocol: cephx
  2629. -583> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding con mode: secure
  2630. -582> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding con mode: crc
  2631. -581> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding con mode: secure
  2632. -580> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding con mode: crc
  2633. -579> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding con mode: secure
  2634. -578> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding con mode: crc
  2635. -577> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding con mode: crc
  2636. -576> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding con mode: secure
  2637. -575> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding con mode: crc
  2638. -574> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding con mode: secure
  2639. -573> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding con mode: crc
  2640. -572> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4bc40) adding con mode: secure
  2641. -571> 2020-12-12 20:23:38.904 7fbe5bf07c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  2642. -570> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding auth protocol: cephx
  2643. -569> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding auth protocol: cephx
  2644. -568> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding auth protocol: cephx
  2645. -567> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding con mode: secure
  2646. -566> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding con mode: crc
  2647. -565> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding con mode: secure
  2648. -564> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding con mode: crc
  2649. -563> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding con mode: secure
  2650. -562> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding con mode: crc
  2651. -561> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding con mode: crc
  2652. -560> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding con mode: secure
  2653. -559> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding con mode: crc
  2654. -558> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding con mode: secure
  2655. -557> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding con mode: crc
  2656. -556> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4c540) adding con mode: secure
  2657. -555> 2020-12-12 20:23:38.904 7fbe5bf07c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  2658. -554> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding auth protocol: cephx
  2659. -553> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding auth protocol: cephx
  2660. -552> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding auth protocol: cephx
  2661. -551> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding con mode: secure
  2662. -550> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding con mode: crc
  2663. -549> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding con mode: secure
  2664. -548> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding con mode: crc
  2665. -547> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding con mode: secure
  2666. -546> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding con mode: crc
  2667. -545> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding con mode: crc
  2668. -544> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding con mode: secure
  2669. -543> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding con mode: crc
  2670. -542> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding con mode: secure
  2671. -541> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding con mode: crc
  2672. -540> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4ce40) adding con mode: secure
  2673. -539> 2020-12-12 20:23:38.904 7fbe5bf07c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  2674. -538> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding auth protocol: cephx
  2675. -537> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding auth protocol: cephx
  2676. -536> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding auth protocol: cephx
  2677. -535> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding con mode: secure
  2678. -534> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding con mode: crc
  2679. -533> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding con mode: secure
  2680. -532> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding con mode: crc
  2681. -531> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding con mode: secure
  2682. -530> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding con mode: crc
  2683. -529> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding con mode: crc
  2684. -528> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding con mode: secure
  2685. -527> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding con mode: crc
  2686. -526> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding con mode: secure
  2687. -525> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding con mode: crc
  2688. -524> 2020-12-12 20:23:38.904 7fbe5bf07c80 5 AuthRegistry(0x561430e4d740) adding con mode: secure
  2689. -523> 2020-12-12 20:23:38.904 7fbe5bf07c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  2690. -522> 2020-12-12 20:23:38.904 7fbe5bf07c80 0 starting osd.11 osd_data /var/lib/ceph/osd/ceph-11 /var/lib/ceph/osd/ceph-11/journal
  2691. -521> 2020-12-12 20:23:38.912 7fbe5bf07c80 10 monclient: build_initial_monmap
  2692. -520> 2020-12-12 20:23:38.912 7fbe5bf07c80 10 monclient: monmap:
  2693. epoch 0
  2694. fsid 00000000-0000-0000-0000-000000000000
  2695. last_changed 0.000000
  2696. created 0.000000
  2697. min_mon_release 0 (unknown)
  2698. 0: [v2:192.168.8.100:3300/0,v1:192.168.8.100:6789/0] mon.noname-b
  2699. 1: [v2:192.168.8.101:3300/0,v1:192.168.8.101:6789/0] mon.noname-a
  2700. 2: [v2:192.168.8.102:3300/0,v1:192.168.8.102:6789/0] mon.noname-c
  2701.  
  2702. -519> 2020-12-12 20:23:38.920 7fbe5bf07c80 0 load: jerasure load: lrc load: isa
  2703. -518> 2020-12-12 20:23:38.920 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  2704. -517> 2020-12-12 20:23:38.920 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  2705. -516> 2020-12-12 20:23:38.920 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2706. -515> 2020-12-12 20:23:38.920 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  2707. -514> 2020-12-12 20:23:38.920 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) close
  2708. -513> 2020-12-12 20:23:39.212 7fbe5bf07c80 5 asok(0x56143026e000) register_command objecter_requests hook 0x5614301d0930
  2709. -512> 2020-12-12 20:23:39.212 7fbe5bf07c80 2 osd.11 0 init /var/lib/ceph/osd/ceph-11 (looks like hdd)
  2710. -511> 2020-12-12 20:23:39.212 7fbe5bf07c80 2 osd.11 0 journal /var/lib/ceph/osd/ceph-11/journal
  2711. -510> 2020-12-12 20:23:39.212 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _mount path /var/lib/ceph/osd/ceph-11
  2712. -509> 2020-12-12 20:23:39.212 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  2713. -508> 2020-12-12 20:23:39.212 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  2714. -507> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev(0x561430ea6000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2715. -506> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  2716. -505> 2020-12-12 20:23:39.216 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore bluefs available hook 0x5614301d0940
  2717. -504> 2020-12-12 20:23:39.216 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore bluefs stats hook 0x5614301d0940
  2718. -503> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  2719. -502> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev(0x561430ea7880 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  2720. -501> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev(0x561430ea7880 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  2721. -500> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  2722. -499> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  2723. -498> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev(0x561430ea7500 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  2724. -497> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bdev(0x561430ea7500 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  2725. -496> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  2726. -495> 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option compaction_readahead_size = 2097152
  2727. -494> 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option compression = kNoCompression
  2728. -493> 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option max_background_compactions = 2
  2729. -492> 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option max_write_buffer_number = 4
  2730. -491> 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  2731. -490> 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option recycle_log_file_num = 4
  2732. -489> 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option writable_file_max_buffer_size = 0
  2733. -488> 2020-12-12 20:23:39.216 7fbe5bf07c80 0 set rocksdb option write_buffer_size = 268435456
  2734. -487> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bluefs mount
  2735. -486> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bluefs _init_alloc id 1 alloc_size 0x100000 size 0x14c8500000
  2736. -485> 2020-12-12 20:23:39.216 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator dump bluefs-db hook 0x561430e6aa20
  2737. -484> 2020-12-12 20:23:39.216 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator score bluefs-db hook 0x561430e6aa20
  2738. -483> 2020-12-12 20:23:39.216 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator fragmentation bluefs-db hook 0x561430e6aa20
  2739. -482> 2020-12-12 20:23:39.216 7fbe5bf07c80 1 bluefs _init_alloc id 2 alloc_size 0x10000 size 0x3a381400000
  2740. -481> 2020-12-12 20:23:39.216 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator dump bluefs-slow hook 0x561430e6a9f0
  2741. -480> 2020-12-12 20:23:39.216 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator score bluefs-slow hook 0x561430e6a9f0
  2742. -479> 2020-12-12 20:23:39.216 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator fragmentation bluefs-slow hook 0x561430e6a9f0
  2743. -478> 2020-12-12 20:23:39.252 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db set db_paths to db,84797030400 db.slow,3800743857356
  2744. -477> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option compaction_readahead_size = 2097152
  2745. -476> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option compression = kNoCompression
  2746. -475> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option max_background_compactions = 2
  2747. -474> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option max_write_buffer_number = 4
  2748. -473> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  2749. -472> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option recycle_log_file_num = 4
  2750. -471> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option writable_file_max_buffer_size = 0
  2751. -470> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option write_buffer_size = 268435456
  2752. -469> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option compaction_readahead_size = 2097152
  2753. -468> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option compression = kNoCompression
  2754. -467> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option max_background_compactions = 2
  2755. -466> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option max_write_buffer_number = 4
  2756. -465> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  2757. -464> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option recycle_log_file_num = 4
  2758. -463> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option writable_file_max_buffer_size = 0
  2759. -462> 2020-12-12 20:23:39.252 7fbe5bf07c80 0 set rocksdb option write_buffer_size = 268435456
  2760. -461> 2020-12-12 20:23:39.252 7fbe5bf07c80 1 rocksdb: do_open column families: [default]
  2761. -460> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: RocksDB version: 6.1.2
  2762.  
  2763. -459> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  2764. -458> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Compile date Dec 2 2020
  2765. -457> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: DB SUMMARY
  2766.  
  2767. -456> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: CURRENT file: CURRENT
  2768.  
  2769. -455> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: IDENTITY file: IDENTITY
  2770.  
  2771. -454> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: MANIFEST file: MANIFEST-003619 size: 6029 Bytes
  2772.  
  2773. -453> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: SST files in db dir, Total Num: 47, files: 000199.sst 000264.sst 000265.sst 000340.sst 000341.sst 000342.sst 000343.sst 000345.sst 000346.sst
  2774.  
  2775. -452> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
  2776.  
  2777. -451> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Write Ahead Log file in db.wal: 003620.log size: 0 ;
  2778.  
  2779. -450> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.error_if_exists: 0
  2780. -449> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.create_if_missing: 0
  2781. -448> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.paranoid_checks: 1
  2782. -447> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.env: 0x561430f58e00
  2783. -446> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.info_log: 0x561430f59820
  2784. -445> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_file_opening_threads: 16
  2785. -444> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.statistics: (nil)
  2786. -443> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.use_fsync: 0
  2787. -442> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_log_file_size: 0
  2788. -441> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
  2789. -440> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.log_file_time_to_roll: 0
  2790. -439> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.keep_log_file_num: 1000
  2791. -438> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.recycle_log_file_num: 4
  2792. -437> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.allow_fallocate: 1
  2793. -436> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.allow_mmap_reads: 0
  2794. -435> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.allow_mmap_writes: 0
  2795. -434> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.use_direct_reads: 0
  2796. -433> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  2797. -432> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.create_missing_column_families: 0
  2798. -431> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.db_log_dir:
  2799. -430> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.wal_dir: db.wal
  2800. -429> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.table_cache_numshardbits: 6
  2801. -428> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_subcompactions: 1
  2802. -427> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_background_flushes: -1
  2803. -426> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.WAL_ttl_seconds: 0
  2804. -425> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.WAL_size_limit_MB: 0
  2805. -424> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
  2806. -423> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.is_fd_close_on_exec: 1
  2807. -422> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.advise_random_on_open: 1
  2808. -421> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.db_write_buffer_size: 0
  2809. -420> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.write_buffer_manager: 0x561430e6acf0
  2810. -419> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
  2811. -418> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  2812. -417> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  2813. -416> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.use_adaptive_mutex: 0
  2814. -415> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.rate_limiter: (nil)
  2815. -414> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  2816. -413> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.wal_recovery_mode: 0
  2817. -412> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.enable_thread_tracking: 0
  2818. -411> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.enable_pipelined_write: 0
  2819. -410> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  2820. -409> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  2821. -408> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
  2822. -407> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  2823. -406> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.row_cache: None
  2824. -405> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.wal_filter: None
  2825. -404> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
  2826. -403> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.allow_ingest_behind: 0
  2827. -402> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.preserve_deletes: 0
  2828. -401> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.two_write_queues: 0
  2829. -400> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.manual_wal_flush: 0
  2830. -399> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.atomic_flush: 0
  2831. -398> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  2832. -397> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_background_jobs: 2
  2833. -396> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_background_compactions: 2
  2834. -395> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  2835. -394> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.writable_file_max_buffer_size: 0
  2836. -393> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.delayed_write_rate : 16777216
  2837. -392> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_total_wal_size: 0
  2838. -391> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  2839. -390> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.stats_dump_period_sec: 600
  2840. -389> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.stats_persist_period_sec: 600
  2841. -388> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
  2842. -387> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_open_files: -1
  2843. -386> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bytes_per_sync: 0
  2844. -385> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.wal_bytes_per_sync: 0
  2845. -384> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_readahead_size: 2097152
  2846. -383> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Compression algorithms supported:
  2847. -382> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
  2848. -381> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kZSTD supported: 0
  2849. -380> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kXpressCompression supported: 0
  2850. -379> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kLZ4HCCompression supported: 1
  2851. -378> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kLZ4Compression supported: 1
  2852. -377> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kBZip2Compression supported: 0
  2853. -376> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kZlibCompression supported: 1
  2854. -375> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: kSnappyCompression supported: 1
  2855. -374> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Fast CRC32 supported: Supported on x86
  2856. -373> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: [db/db_impl_readonly.cc:22] Opening the db in read only mode
  2857. -372> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-003619
  2858.  
  2859. -371> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  2860.  
  2861. -370> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  2862. -369> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  2863. -368> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_filter: None
  2864. -367> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_filter_factory: None
  2865. -366> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.memtable_factory: SkipListFactory
  2866. -365> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.table_factory: BlockBasedTable
  2867. -364> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5614302ca248)
  2868. cache_index_and_filter_blocks: 1
  2869. cache_index_and_filter_blocks_with_high_priority: 1
  2870. pin_l0_filter_and_index_blocks_in_cache: 0
  2871. pin_top_level_index_and_filter: 1
  2872. index_type: 0
  2873. data_block_index_type: 0
  2874. data_block_hash_table_util_ratio: 0.750000
  2875. hash_index_allow_collision: 1
  2876. checksum: 1
  2877. no_block_cache: 0
  2878. block_cache: 0x561430218a10
  2879. block_cache_name: BinnedLRUCache
  2880. block_cache_options:
  2881. capacity : 429496729
  2882. num_shard_bits : 4
  2883. strict_capacity_limit : 0
  2884. high_pri_pool_ratio: 0.000
  2885. block_cache_compressed: (nil)
  2886. persistent_cache: (nil)
  2887. block_size: 4096
  2888. block_size_deviation: 10
  2889. block_restart_interval: 16
  2890. index_block_restart_interval: 1
  2891. metadata_block_size: 4096
  2892. partition_filters: 0
  2893. use_delta_encoding: 1
  2894. filter_policy: rocksdb.BuiltinBloomFilter
  2895. whole_key_filtering: 1
  2896. verify_compression: 0
  2897. read_amp_bytes_per_bit: 0
  2898. format_version: 2
  2899. enable_index_compression: 1
  2900. block_align: 0
  2901.  
  2902. -363> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.write_buffer_size: 268435456
  2903. -362> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_write_buffer_number: 4
  2904. -361> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression: NoCompression
  2905. -360> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression: Disabled
  2906. -359> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.prefix_extractor: nullptr
  2907. -358> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  2908. -357> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.num_levels: 7
  2909. -356> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  2910. -355> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  2911. -354> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  2912. -353> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  2913. -352> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  2914. -351> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  2915. -350> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  2916. -349> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  2917. -348> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression_opts.window_bits: -14
  2918. -347> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression_opts.level: 32767
  2919. -346> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression_opts.strategy: 0
  2920. -345> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  2921. -344> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  2922. -343> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compression_opts.enabled: false
  2923. -342> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  2924. -341> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  2925. -340> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
  2926. -339> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.target_file_size_base: 67108864
  2927. -338> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.target_file_size_multiplier: 1
  2928. -337> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  2929. -336> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  2930. -335> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  2931. -334> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  2932. -333> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  2933. -332> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  2934. -331> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  2935. -330> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  2936. -329> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  2937. -328> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  2938. -327> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  2939. -326> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
  2940. -325> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.arena_block_size: 33554432
  2941. -324> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  2942. -323> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  2943. -322> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  2944. -321> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.disable_auto_compactions: 0
  2945. -320> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  2946. -319> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  2947. -318> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  2948. -317> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  2949. -316> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  2950. -315> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  2951. -314> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  2952. -313> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  2953. -312> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  2954. -311> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  2955. -310> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.table_properties_collectors:
  2956. -309> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.inplace_update_support: 0
  2957. -308> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.inplace_update_num_locks: 10000
  2958. -307> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  2959. -306> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
  2960. -305> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.memtable_huge_page_size: 0
  2961. -304> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.bloom_locality: 0
  2962. -303> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.max_successive_merges: 0
  2963. -302> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.optimize_filters_for_hits: 0
  2964. -301> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.paranoid_file_checks: 0
  2965. -300> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.force_consistency_checks: 0
  2966. -299> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.report_bg_io_stats: 0
  2967. -298> 2020-12-12 20:23:39.252 7fbe5bf07c80 4 rocksdb: Options.ttl: 0
  2968. -297> 2020-12-12 20:23:39.256 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-003619 succeeded,manifest_file_number is 3619, next_file_number is 3621, last_sequence is 22382894, log_number is 3618,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  2969.  
  2970. -296> 2020-12-12 20:23:39.256 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 3618
  2971.  
  2972. -295> 2020-12-12 20:23:39.256 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019261216, "job": 1, "event": "recovery_started", "log_files": [3620]}
  2973. -294> 2020-12-12 20:23:39.256 7fbe5bf07c80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3620 mode 0
  2974. -293> 2020-12-12 20:23:39.256 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019261242, "job": 1, "event": "recovery_finished"}
  2975. -292> 2020-12-12 20:23:39.256 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  2976. -291> 2020-12-12 20:23:39.264 7fbe5bf07c80 1 get compressor snappy = 0
  2977. -290> 2020-12-12 20:23:39.264 7fbe5bf07c80 1 load compressor snappy
  2978. -289> 2020-12-12 20:23:39.264 7fbe5bf07c80 1 add compressor snappy 0x5614311f5080
  2979. -288> 2020-12-12 20:23:39.264 7fbe5bf07c80 1 get compressor snappy = 0x5614311f5080
  2980. -287> 2020-12-12 20:23:39.264 7fbe5bf07c80 1 load: compressor snappy loaded and registered
  2981. -286> 2020-12-12 20:23:39.264 7fbe5bf07c80 1 get compressor snappy = 0x5614311f5080
  2982. -285> 2020-12-12 20:23:39.264 7fbe5bf07c80 1 freelist init
  2983. -284> 2020-12-12 20:23:39.268 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator dump block hook 0x5614311f5170
  2984. -283> 2020-12-12 20:23:39.268 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator score block hook 0x5614311f5170
  2985. -282> 2020-12-12 20:23:39.268 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator fragmentation block hook 0x5614311f5170
  2986. -281> 2020-12-12 20:23:39.268 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_alloc opening allocation metadata
  2987. -280> 2020-12-12 20:23:39.424 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_alloc loaded 2.3 TiB in 139875 extents available 2.2 TiB
  2988. -279> 2020-12-12 20:23:39.424 7fbe5bf07c80 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work
  2989. -278> 2020-12-12 20:23:39.424 7fbe5bf07c80 4 rocksdb: [db/db_impl.cc:563] Shutdown complete
  2990. -277> 2020-12-12 20:23:39.424 7fbe5bf07c80 1 bluefs umount
  2991. -276> 2020-12-12 20:23:39.424 7fbe5bf07c80 5 asok(0x56143026e000) unregister_command bluestore allocator dump bluefs-db
  2992. -275> 2020-12-12 20:23:39.424 7fbe5bf07c80 5 asok(0x56143026e000) unregister_command bluestore allocator score bluefs-db
  2993. -274> 2020-12-12 20:23:39.424 7fbe5bf07c80 5 asok(0x56143026e000) unregister_command bluestore allocator fragmentation bluefs-db
  2994. -273> 2020-12-12 20:23:39.424 7fbe5bf07c80 5 asok(0x56143026e000) unregister_command bluestore allocator dump bluefs-slow
  2995. -272> 2020-12-12 20:23:39.424 7fbe5bf07c80 5 asok(0x56143026e000) unregister_command bluestore allocator score bluefs-slow
  2996. -271> 2020-12-12 20:23:39.424 7fbe5bf07c80 5 asok(0x56143026e000) unregister_command bluestore allocator fragmentation bluefs-slow
  2997. -270> 2020-12-12 20:23:39.424 7fbe5bf07c80 5 asok(0x56143026e000) unregister_commands bluestore bluefs available
  2998. -269> 2020-12-12 20:23:39.424 7fbe5bf07c80 5 asok(0x56143026e000) unregister_commands bluestore bluefs stats
  2999. -268> 2020-12-12 20:23:39.424 7fbe5bf07c80 1 bdev(0x561430ea7880 /var/lib/ceph/osd/ceph-11/block.db) close
  3000. -267> 2020-12-12 20:23:39.500 7fbe5bf07c80 1 bdev(0x561430ea7500 /var/lib/ceph/osd/ceph-11/block) close
  3001. -266> 2020-12-12 20:23:39.756 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore bluefs available hook 0x5614301d0940
  3002. -265> 2020-12-12 20:23:39.756 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore bluefs stats hook 0x5614301d0940
  3003. -264> 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  3004. -263> 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bdev(0x561430ea7500 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  3005. -262> 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bdev(0x561430ea7500 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3006. -261> 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  3007. -260> 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  3008. -259> 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bdev(0x561430ea7880 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  3009. -258> 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bdev(0x561430ea7880 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3010. -257> 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  3011. -256> 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option compaction_readahead_size = 2097152
  3012. -255> 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option compression = kNoCompression
  3013. -254> 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option max_background_compactions = 2
  3014. -253> 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option max_write_buffer_number = 4
  3015. -252> 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  3016. -251> 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option recycle_log_file_num = 4
  3017. -250> 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option writable_file_max_buffer_size = 0
  3018. -249> 2020-12-12 20:23:39.756 7fbe5bf07c80 0 set rocksdb option write_buffer_size = 268435456
  3019. -248> 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bluefs mount
  3020. -247> 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bluefs _init_alloc id 1 alloc_size 0x100000 size 0x14c8500000
  3021. -246> 2020-12-12 20:23:39.756 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator dump bluefs-db hook 0x561430e6aba0
  3022. -245> 2020-12-12 20:23:39.756 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator score bluefs-db hook 0x561430e6aba0
  3023. -244> 2020-12-12 20:23:39.756 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator fragmentation bluefs-db hook 0x561430e6aba0
  3024. -243> 2020-12-12 20:23:39.756 7fbe5bf07c80 1 bluefs _init_alloc id 2 alloc_size 0x10000 size 0x3a381400000
  3025. -242> 2020-12-12 20:23:39.756 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator dump bluefs-slow hook 0x561430e6ab70
  3026. -241> 2020-12-12 20:23:39.756 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator score bluefs-slow hook 0x561430e6ab70
  3027. -240> 2020-12-12 20:23:39.756 7fbe5bf07c80 5 asok(0x56143026e000) register_command bluestore allocator fragmentation bluefs-slow hook 0x561430e6ab70
  3028. -239> 2020-12-12 20:23:39.792 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db set db_paths to db,84797030400 db.slow,3800743857356
  3029. -238> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option compaction_readahead_size = 2097152
  3030. -237> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option compression = kNoCompression
  3031. -236> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option max_background_compactions = 2
  3032. -235> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option max_write_buffer_number = 4
  3033. -234> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  3034. -233> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option recycle_log_file_num = 4
  3035. -232> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option writable_file_max_buffer_size = 0
  3036. -231> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option write_buffer_size = 268435456
  3037. -230> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option compaction_readahead_size = 2097152
  3038. -229> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option compression = kNoCompression
  3039. -228> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option max_background_compactions = 2
  3040. -227> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option max_write_buffer_number = 4
  3041. -226> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  3042. -225> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option recycle_log_file_num = 4
  3043. -224> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option writable_file_max_buffer_size = 0
  3044. -223> 2020-12-12 20:23:39.792 7fbe5bf07c80 0 set rocksdb option write_buffer_size = 268435456
  3045. -222> 2020-12-12 20:23:39.792 7fbe5bf07c80 1 rocksdb: do_open column families: [default]
  3046. -221> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: RocksDB version: 6.1.2
  3047.  
  3048. -220> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  3049. -219> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Compile date Dec 2 2020
  3050. -218> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: DB SUMMARY
  3051.  
  3052. -217> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: CURRENT file: CURRENT
  3053.  
  3054. -216> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: IDENTITY file: IDENTITY
  3055.  
  3056. -215> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: MANIFEST file: MANIFEST-003619 size: 6029 Bytes
  3057.  
  3058. -214> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: SST files in db dir, Total Num: 47, files: 000199.sst 000264.sst 000265.sst 000340.sst 000341.sst 000342.sst 000343.sst 000345.sst 000346.sst
  3059.  
  3060. -213> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
  3061.  
  3062. -212> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Write Ahead Log file in db.wal: 003620.log size: 0 ;
  3063.  
  3064. -211> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.error_if_exists: 0
  3065. -210> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.create_if_missing: 0
  3066. -209> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.paranoid_checks: 1
  3067. -208> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.env: 0x561431950d20
  3068. -207> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.info_log: 0x5614319503c0
  3069. -206> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_file_opening_threads: 16
  3070. -205> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.statistics: (nil)
  3071. -204> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.use_fsync: 0
  3072. -203> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_log_file_size: 0
  3073. -202> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
  3074. -201> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.log_file_time_to_roll: 0
  3075. -200> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.keep_log_file_num: 1000
  3076. -199> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.recycle_log_file_num: 4
  3077. -198> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.allow_fallocate: 1
  3078. -197> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.allow_mmap_reads: 0
  3079. -196> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.allow_mmap_writes: 0
  3080. -195> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.use_direct_reads: 0
  3081. -194> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  3082. -193> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.create_missing_column_families: 0
  3083. -192> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.db_log_dir:
  3084. -191> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.wal_dir: db.wal
  3085. -190> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.table_cache_numshardbits: 6
  3086. -189> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_subcompactions: 1
  3087. -188> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_background_flushes: -1
  3088. -187> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.WAL_ttl_seconds: 0
  3089. -186> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.WAL_size_limit_MB: 0
  3090. -185> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
  3091. -184> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.is_fd_close_on_exec: 1
  3092. -183> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.advise_random_on_open: 1
  3093. -182> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.db_write_buffer_size: 0
  3094. -181> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.write_buffer_manager: 0x5614311f4000
  3095. -180> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
  3096. -179> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  3097. -178> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  3098. -177> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.use_adaptive_mutex: 0
  3099. -176> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.rate_limiter: (nil)
  3100. -175> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  3101. -174> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.wal_recovery_mode: 0
  3102. -173> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.enable_thread_tracking: 0
  3103. -172> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.enable_pipelined_write: 0
  3104. -171> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  3105. -170> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  3106. -169> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
  3107. -168> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  3108. -167> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.row_cache: None
  3109. -166> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.wal_filter: None
  3110. -165> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
  3111. -164> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.allow_ingest_behind: 0
  3112. -163> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.preserve_deletes: 0
  3113. -162> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.two_write_queues: 0
  3114. -161> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.manual_wal_flush: 0
  3115. -160> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.atomic_flush: 0
  3116. -159> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  3117. -158> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_background_jobs: 2
  3118. -157> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_background_compactions: 2
  3119. -156> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  3120. -155> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.writable_file_max_buffer_size: 0
  3121. -154> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.delayed_write_rate : 16777216
  3122. -153> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_total_wal_size: 0
  3123. -152> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  3124. -151> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.stats_dump_period_sec: 600
  3125. -150> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.stats_persist_period_sec: 600
  3126. -149> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
  3127. -148> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_open_files: -1
  3128. -147> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bytes_per_sync: 0
  3129. -146> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.wal_bytes_per_sync: 0
  3130. -145> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_readahead_size: 2097152
  3131. -144> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Compression algorithms supported:
  3132. -143> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
  3133. -142> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kZSTD supported: 0
  3134. -141> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kXpressCompression supported: 0
  3135. -140> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kLZ4HCCompression supported: 1
  3136. -139> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kLZ4Compression supported: 1
  3137. -138> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kBZip2Compression supported: 0
  3138. -137> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kZlibCompression supported: 1
  3139. -136> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: kSnappyCompression supported: 1
  3140. -135> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Fast CRC32 supported: Supported on x86
  3141. -134> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-003619
  3142.  
  3143. -133> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  3144.  
  3145. -132> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  3146. -131> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  3147. -130> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_filter: None
  3148. -129> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_filter_factory: None
  3149. -128> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.memtable_factory: SkipListFactory
  3150. -127> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.table_factory: BlockBasedTable
  3151. -126> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5614302ca240)
  3152. cache_index_and_filter_blocks: 1
  3153. cache_index_and_filter_blocks_with_high_priority: 1
  3154. pin_l0_filter_and_index_blocks_in_cache: 0
  3155. pin_top_level_index_and_filter: 1
  3156. index_type: 0
  3157. data_block_index_type: 0
  3158. data_block_hash_table_util_ratio: 0.750000
  3159. hash_index_allow_collision: 1
  3160. checksum: 1
  3161. no_block_cache: 0
  3162. block_cache: 0x561430218910
  3163. block_cache_name: BinnedLRUCache
  3164. block_cache_options:
  3165. capacity : 429496729
  3166. num_shard_bits : 4
  3167. strict_capacity_limit : 0
  3168. high_pri_pool_ratio: 0.000
  3169. block_cache_compressed: (nil)
  3170. persistent_cache: (nil)
  3171. block_size: 4096
  3172. block_size_deviation: 10
  3173. block_restart_interval: 16
  3174. index_block_restart_interval: 1
  3175. metadata_block_size: 4096
  3176. partition_filters: 0
  3177. use_delta_encoding: 1
  3178. filter_policy: rocksdb.BuiltinBloomFilter
  3179. whole_key_filtering: 1
  3180. verify_compression: 0
  3181. read_amp_bytes_per_bit: 0
  3182. format_version: 2
  3183. enable_index_compression: 1
  3184. block_align: 0
  3185.  
  3186. -125> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.write_buffer_size: 268435456
  3187. -124> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_write_buffer_number: 4
  3188. -123> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression: NoCompression
  3189. -122> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression: Disabled
  3190. -121> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.prefix_extractor: nullptr
  3191. -120> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  3192. -119> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.num_levels: 7
  3193. -118> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  3194. -117> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  3195. -116> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  3196. -115> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  3197. -114> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  3198. -113> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  3199. -112> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  3200. -111> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  3201. -110> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression_opts.window_bits: -14
  3202. -109> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression_opts.level: 32767
  3203. -108> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression_opts.strategy: 0
  3204. -107> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  3205. -106> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  3206. -105> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compression_opts.enabled: false
  3207. -104> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  3208. -103> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  3209. -102> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
  3210. -101> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.target_file_size_base: 67108864
  3211. -100> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.target_file_size_multiplier: 1
  3212. -99> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  3213. -98> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  3214. -97> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  3215. -96> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  3216. -95> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  3217. -94> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  3218. -93> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  3219. -92> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  3220. -91> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  3221. -90> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  3222. -89> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  3223. -88> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
  3224. -87> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.arena_block_size: 33554432
  3225. -86> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  3226. -85> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  3227. -84> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  3228. -83> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.disable_auto_compactions: 0
  3229. -82> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  3230. -81> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  3231. -80> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  3232. -79> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  3233. -78> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  3234. -77> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  3235. -76> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  3236. -75> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  3237. -74> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  3238. -73> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  3239. -72> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.table_properties_collectors:
  3240. -71> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.inplace_update_support: 0
  3241. -70> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.inplace_update_num_locks: 10000
  3242. -69> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  3243. -68> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
  3244. -67> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.memtable_huge_page_size: 0
  3245. -66> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.bloom_locality: 0
  3246. -65> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.max_successive_merges: 0
  3247. -64> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.optimize_filters_for_hits: 0
  3248. -63> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.paranoid_file_checks: 0
  3249. -62> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.force_consistency_checks: 0
  3250. -61> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.report_bg_io_stats: 0
  3251. -60> 2020-12-12 20:23:39.792 7fbe5bf07c80 4 rocksdb: Options.ttl: 0
  3252. -59> 2020-12-12 20:23:39.796 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-003619 succeeded,manifest_file_number is 3619, next_file_number is 3621, last_sequence is 22382894, log_number is 3618,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  3253.  
  3254. -58> 2020-12-12 20:23:39.796 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 3618
  3255.  
  3256. -57> 2020-12-12 20:23:39.796 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019801442, "job": 1, "event": "recovery_started", "log_files": [3620]}
  3257. -56> 2020-12-12 20:23:39.796 7fbe5bf07c80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3620 mode 0
  3258. -55> 2020-12-12 20:23:39.796 7fbe5bf07c80 4 rocksdb: [db/version_set.cc:3036] Creating manifest 3622
  3259.  
  3260. -54> 2020-12-12 20:23:39.800 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019804425, "job": 1, "event": "recovery_finished"}
  3261. -53> 2020-12-12 20:23:39.800 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019804501, "job": 2, "event": "table_file_deletion", "file_number": 3626}
  3262. -52> 2020-12-12 20:23:39.800 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019804515, "job": 2, "event": "table_file_deletion", "file_number": 3625}
  3263. -51> 2020-12-12 20:23:39.800 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019804522, "job": 2, "event": "table_file_deletion", "file_number": 3624}
  3264. -50> 2020-12-12 20:23:39.800 7fbe5bf07c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019804528, "job": 2, "event": "table_file_deletion", "file_number": 3623}
  3265. -49> 2020-12-12 20:23:39.804 7fbe5bf07c80 4 rocksdb: DB pointer 0x561431d54000
  3266. -48> 2020-12-12 20:23:39.804 7fbe50c28700 4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 3] Compacting 1@1 + 4@2 files to L2, score 1.03
  3267. -47> 2020-12-12 20:23:39.804 7fbe50c28700 4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 2 Base level 1, inputs: [449(64MB)], [345(64MB) 346(64MB) 347(64MB) 348(64MB)]
  3268.  
  3269. -46> 2020-12-12 20:23:39.804 7fbe50c28700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837019807415, "job": 3, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [449], "files_L2": [345, 346, 347, 348], "score": 1.02872, "input_data_size": 338693918}
  3270. -45> 2020-12-12 20:23:39.804 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  3271. -44> 2020-12-12 20:23:39.804 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _upgrade_super from 2, latest 2
  3272. -43> 2020-12-12 20:23:39.804 7fbe5bf07c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _upgrade_super done
  3273. -42> 2020-12-12 20:23:39.804 7fbe48417700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS -------
  3274. -41> 2020-12-12 20:23:39.804 7fbe48417700 4 rocksdb: [db/db_impl.cc:778]
  3275. ** DB Stats **
  3276. Uptime(secs): 0.0 total, 0.0 interval
  3277. Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
  3278. Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
  3279. Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
  3280. Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
  3281. Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
  3282. Interval stall: 00:00:0.000 H:M:S, 0.0 percent
  3283.  
  3284. ** Compaction Stats [default] **
  3285. Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  3286. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  3287. L0 2/0 3.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  3288. L1 4/1 194.65 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  3289. L2 37/4 2.22 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  3290. Sum 43/5 2.41 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  3291. Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  3292.  
  3293. ** Compaction Stats [default] **
  3294. Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  3295. -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  3296. Uptime(secs): 0.0 total, 0.0 interval
  3297. Flush(GB): cumulative 0.000, interval 0.000
  3298. AddFile(GB): cumulative 0.000, interval 0.000
  3299. AddFile(Total Files): cumulative 0, interval 0
  3300. AddFile(L0 Files): cumulative 0, interval 0
  3301. AddFile(Keys): cumulative 0, interval 0
  3302. Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  3303. Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  3304. Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
  3305.  
  3306. ** File Read Latency Histogram By Level [default] **
  3307.  
  3308. ** Compaction Stats [default] **
  3309. Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  3310. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  3311. L0 2/0 3.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  3312. L1 4/1 194.65 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  3313. L2 37/4 2.22 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  3314. Sum 43/5 2.41 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  3315. Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  3316.  
  3317. ** Compaction Stats [default] **
  3318. Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  3319. -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  3320. Uptime(secs): 0.0 total, 0.0 interval
  3321. Flush(GB): cumulative 0.000, interval 0.000
  3322. AddFile(GB): cumulative 0.000, interval 0.000
  3323. AddFile(Total Files): cumulative 0, interval 0
  3324. AddFile(L0 Files): cumulative 0, interval 0
  3325. AddFile(Keys): cumulative 0, interval 0
  3326. Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  3327. Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  3328. Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
  3329.  
  3330. ** File Read Latency Histogram By Level [default] **
  3331.  
  3332. -40> 2020-12-12 20:23:39.844 7fbe5bf07c80 2 osd.11 0 journal looks like ssd
  3333. -39> 2020-12-12 20:23:39.844 7fbe5bf07c80 2 osd.11 0 boot
  3334. -38> 2020-12-12 20:23:39.844 7fbe4e423700 5 prioritycache tune_memory target: 4294967296 mapped: 47718400 unmapped: 1982464 heap: 49700864 old mem: 134217728 new mem: 2815293593
  3335. -37> 2020-12-12 20:23:39.844 7fbe4e423700 5 prioritycache tune_memory target: 4294967296 mapped: 48373760 unmapped: 1327104 heap: 49700864 old mem: 2815293593 new mem: 2845076569
  3336. -36> 2020-12-12 20:23:39.844 7fbe4e423700 5 bluestore.MempoolThread(0x561430f8cb70) _trim_shards cache_size: 2845076569 kv_alloc: 1056964608 kv_used: 3206336 meta_alloc: 1056964608 meta_used: 15896 data_alloc: 671088640 data_used: 0
  3337. -35> 2020-12-12 20:23:39.852 7fbe5bf07c80 0 _get_class not permitted to load sdk
  3338. -34> 2020-12-12 20:23:39.852 7fbe5bf07c80 0 <cls> /build/ceph/ceph-14.2.15/src/cls/hello/cls_hello.cc:296: loading cls_hello
  3339. -33> 2020-12-12 20:23:39.852 7fbe5bf07c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/user/cls_user.cc:429: Loaded user class!
  3340. -32> 2020-12-12 20:23:39.852 7fbe5bf07c80 0 _get_class not permitted to load lua
  3341. -31> 2020-12-12 20:23:39.856 7fbe5bf07c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/refcount/cls_refcount.cc:198: Loaded refcount class!
  3342. -30> 2020-12-12 20:23:39.856 7fbe5bf07c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/timeindex/cls_timeindex.cc:242: Loaded timeindex class!
  3343. -29> 2020-12-12 20:23:39.856 7fbe5bf07c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/rgw/cls_rgw.cc:3905: Loaded rgw class!
  3344. -28> 2020-12-12 20:23:39.860 7fbe5bf07c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/log/cls_log.cc:299: Loaded log class!
  3345. -27> 2020-12-12 20:23:39.860 7fbe5bf07c80 0 _get_class not permitted to load kvs
  3346. -26> 2020-12-12 20:23:39.860 7fbe5bf07c80 0 <cls> /build/ceph/ceph-14.2.15/src/cls/cephfs/cls_cephfs.cc:197: loading cephfs
  3347. -25> 2020-12-12 20:23:39.860 7fbe5bf07c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/cas/cls_cas.cc:237: Loaded cas class!
  3348. -24> 2020-12-12 20:23:39.860 7fbe5bf07c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/version/cls_version.cc:214: Loaded version class!
  3349. -23> 2020-12-12 20:23:39.860 7fbe5bf07c80 0 osd.11 120674 crush map has features 432629308056666112, adjusting msgr requires for clients
  3350. -22> 2020-12-12 20:23:39.860 7fbe5bf07c80 0 osd.11 120674 crush map has features 432629308056666112 was 8705, adjusting msgr requires for mons
  3351. -21> 2020-12-12 20:23:39.860 7fbe5bf07c80 0 osd.11 120674 crush map has features 3314933069573799936, adjusting msgr requires for osds
  3352. -20> 2020-12-12 20:23:40.244 7fbe50c28700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3626: 42754 keys, 67717992 bytes
  3353. -19> 2020-12-12 20:23:40.244 7fbe50c28700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837020248383, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3626, "file_size": 67717992, "table_properties": {"data_size": 67112720, "index_size": 497464, "filter_size": 106949, "raw_key_size": 2795150, "raw_average_key_size": 65, "raw_value_size": 64371790, "raw_average_value_size": 1505, "num_data_blocks": 14079, "num_entries": 42754, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  3354. -18> 2020-12-12 20:23:40.640 7fbe50c28700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3627: 43658 keys, 67732235 bytes
  3355. -17> 2020-12-12 20:23:40.640 7fbe50c28700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837020643165, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3627, "file_size": 67732235, "table_properties": {"data_size": 67111811, "index_size": 510312, "filter_size": 109253, "raw_key_size": 3756526, "raw_average_key_size": 86, "raw_value_size": 63462002, "raw_average_value_size": 1453, "num_data_blocks": 14230, "num_entries": 43658, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  3356. -16> 2020-12-12 20:23:40.848 7fbe4e423700 5 prioritycache tune_memory target: 4294967296 mapped: 127672320 unmapped: 6963200 heap: 134635520 old mem: 2845076569 new mem: 2845405748
  3357. -15> 2020-12-12 20:23:41.024 7fbe50c28700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3628: 43657 keys, 67729297 bytes
  3358. -14> 2020-12-12 20:23:41.024 7fbe50c28700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837021027524, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3628, "file_size": 67729297, "table_properties": {"data_size": 67113092, "index_size": 506093, "filter_size": 109253, "raw_key_size": 3372528, "raw_average_key_size": 77, "raw_value_size": 63853503, "raw_average_value_size": 1462, "num_data_blocks": 14172, "num_entries": 43657, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  3359. -13> 2020-12-12 20:23:41.400 7fbe50c28700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3629: 42522 keys, 67713983 bytes
  3360. -12> 2020-12-12 20:23:41.400 7fbe50c28700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837021404072, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3629, "file_size": 67713983, "table_properties": {"data_size": 67112021, "index_size": 494666, "filter_size": 106437, "raw_key_size": 2680741, "raw_average_key_size": 63, "raw_value_size": 64464845, "raw_average_value_size": 1516, "num_data_blocks": 14067, "num_entries": 42522, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  3361. -11> 2020-12-12 20:23:41.544 7fbe5bf07c80 0 osd.11 120674 load_pgs
  3362. -10> 2020-12-12 20:23:41.560 7fbe5bf07c80 5 osd.11 pg_epoch: 120674 pg[19.fs2(unlocked)] enter Initial
  3363. -9> 2020-12-12 20:23:41.688 7fbe50c28700 3 rocksdb: [db/db_impl_compaction_flush.cc:2660] Compaction error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704
  3364. -8> 2020-12-12 20:23:41.688 7fbe50c28700 4 rocksdb: (Original Log Time 2020/12/12-20:23:41.693356) [db/compaction_job.cc:768] [default] compacted to: files[2 4 37 0 0 0 0] max score 0.79, MB/sec: 179.6 rd, 143.6 wr, level 2, files in(1, 4) out(5) MB in(64.7, 258.3) out(258.3), read-write-amplify(9.0) write-amplify(4.0) Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704, records in: 243696, records dropped: 28515 output_compression: NoCompression
  3365.  
  3366. -7> 2020-12-12 20:23:41.688 7fbe50c28700 4 rocksdb: (Original Log Time 2020/12/12-20:23:41.693410) EVENT_LOG_v1 {"time_micros": 1607837021693385, "job": 3, "event": "compaction_finished", "compaction_time_micros": 1885886, "compaction_time_cpu_micros": 452394, "output_level": 2, "num_output_files": 5, "total_output_size": 318240797, "num_input_records": 231169, "num_output_records": 202654, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [2, 4, 37, 0, 0, 0, 0]}
  3367. -6> 2020-12-12 20:23:41.688 7fbe50c28700 2 rocksdb: [db/db_impl_compaction_flush.cc:2212] Waiting after background compaction error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704, Accumulated background error counts: 1
  3368. -5> 2020-12-12 20:23:41.764 7fbe5bf07c80 5 osd.11 pg_epoch: 120674 pg[19.fs2( v 120655'13314733 (120632'13311706,120655'13314733] lb 19:f6f3c78a:::rbd_data.16.9bfacae1273d4e.000000000003951a:head (bitwise) local-lis/les=120084/120085 n=45780 ec=1670/1670 lis/c 120666/119858 les/c/f 120667/119859/0 120674/120674/120674) [2147483647,0,11,7,1,5]/[2147483647,0,8,2147483647,1,5]p0(1) r=-1 lpr=0 pi=[119858,120674)/5 crt=120655'13314733 lcod 0'0 unknown mbc={} ps=[2cd~1,2cf~1,2d1~2,2d4~1,2d6~1,2d8~1,2da~1,2dd~1]] exit Initial 0.204811 0 0.000000
  3369. -4> 2020-12-12 20:23:41.764 7fbe5bf07c80 5 osd.11 pg_epoch: 120674 pg[19.fs2( v 120655'13314733 (120632'13311706,120655'13314733] lb 19:f6f3c78a:::rbd_data.16.9bfacae1273d4e.000000000003951a:head (bitwise) local-lis/les=120084/120085 n=45780 ec=1670/1670 lis/c 120666/119858 les/c/f 120667/119859/0 120674/120674/120674) [2147483647,0,11,7,1,5]/[2147483647,0,8,2147483647,1,5]p0(1) r=-1 lpr=0 pi=[119858,120674)/5 crt=120655'13314733 lcod 0'0 unknown mbc={} ps=[2cd~1,2cf~1,2d1~2,2d4~1,2d6~1,2d8~1,2da~1,2dd~1]] enter Reset
  3370. -3> 2020-12-12 20:23:41.764 7fbe4f425700 -1 rocksdb: submit_common error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704 code = 2 Rocksdb transaction:
  3371. Put( Prefix = P key = 0x000000000000146e'.can_rollback_to' Value size = 12)
  3372. Put( Prefix = P key = 0x000000000000146e'.rollback_info_trimmed_to' Value size = 12)
  3373. Put( Prefix = O key = 0x828000000000000013f000000021213dfffffffffffffffeffffffffffffffff'o' Value size = 29)
  3374. Put( Prefix = S key = 'nid_max' Value size = 8)
  3375. Put( Prefix = S key = 'blobid_max' Value size = 8)
  3376. -2> 2020-12-12 20:23:41.764 7fbe5bf07c80 5 osd.11 pg_epoch: 120674 pg[19.cs1(unlocked)] enter Initial
  3377. -1> 2020-12-12 20:23:41.768 7fbe4f425700 -1 /build/ceph/ceph-14.2.15/src/os/bluestore/BlueStore.cc: In function 'void BlueStore::_kv_sync_thread()' thread 7fbe4f425700 time 2020-12-12 20:23:41.768820
  3378. /build/ceph/ceph-14.2.15/src/os/bluestore/BlueStore.cc: 11380: FAILED ceph_assert(r == 0)
  3379.  
  3380. ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable)
  3381. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x5614258c5c1e]
  3382. 2: (()+0x513df6) [0x5614258c5df6]
  3383. 3: (BlueStore::_kv_sync_thread()+0x1826) [0x561425e5e766]
  3384. 4: (BlueStore::KVSyncThread::entry()+0xd) [0x561425e849bd]
  3385. 5: (()+0x7fa3) [0x7fbe5c94bfa3]
  3386. 6: (clone()+0x3f) [0x7fbe5c4fb4cf]
  3387.  
  3388. 0> 2020-12-12 20:23:41.768 7fbe4f425700 -1 *** Caught signal (Aborted) **
  3389. in thread 7fbe4f425700 thread_name:bstore_kv_sync
  3390.  
  3391. ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable)
  3392. 1: (()+0x12730) [0x7fbe5c956730]
  3393. 2: (gsignal()+0x10b) [0x7fbe5c4397bb]
  3394. 3: (abort()+0x121) [0x7fbe5c424535]
  3395. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x5614258c5c6f]
  3396. 5: (()+0x513df6) [0x5614258c5df6]
  3397. 6: (BlueStore::_kv_sync_thread()+0x1826) [0x561425e5e766]
  3398. 7: (BlueStore::KVSyncThread::entry()+0xd) [0x561425e849bd]
  3399. 8: (()+0x7fa3) [0x7fbe5c94bfa3]
  3400. 9: (clone()+0x3f) [0x7fbe5c4fb4cf]
  3401. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  3402.  
  3403. --- logging levels ---
  3404. 0/ 5 none
  3405. 0/ 1 lockdep
  3406. 0/ 1 context
  3407. 1/ 1 crush
  3408. 1/ 5 mds
  3409. 1/ 5 mds_balancer
  3410. 1/ 5 mds_locker
  3411. 1/ 5 mds_log
  3412. 1/ 5 mds_log_expire
  3413. 1/ 5 mds_migrator
  3414. 0/ 1 buffer
  3415. 0/ 1 timer
  3416. 0/ 1 filer
  3417. 0/ 1 striper
  3418. 0/ 1 objecter
  3419. 0/ 5 rados
  3420. 0/ 5 rbd
  3421. 0/ 5 rbd_mirror
  3422. 0/ 5 rbd_replay
  3423. 0/ 5 journaler
  3424. 0/ 5 objectcacher
  3425. 0/ 5 client
  3426. 1/ 5 osd
  3427. 0/ 5 optracker
  3428. 0/ 5 objclass
  3429. 1/ 3 filestore
  3430. 1/ 3 journal
  3431. 0/ 0 ms
  3432. 1/ 5 mon
  3433. 0/10 monc
  3434. 1/ 5 paxos
  3435. 0/ 5 tp
  3436. 1/ 5 auth
  3437. 1/ 5 crypto
  3438. 1/ 1 finisher
  3439. 1/ 1 reserver
  3440. 1/ 5 heartbeatmap
  3441. 1/ 5 perfcounter
  3442. 1/ 5 rgw
  3443. 1/ 5 rgw_sync
  3444. 1/10 civetweb
  3445. 1/ 5 javaclient
  3446. 1/ 5 asok
  3447. 1/ 1 throttle
  3448. 0/ 0 refs
  3449. 1/ 5 xio
  3450. 1/ 5 compressor
  3451. 1/ 5 bluestore
  3452. 1/ 5 bluefs
  3453. 1/ 3 bdev
  3454. 1/ 5 kstore
  3455. 4/ 5 rocksdb
  3456. 4/ 5 leveldb
  3457. 4/ 5 memdb
  3458. 1/ 5 kinetic
  3459. 1/ 5 fuse
  3460. 1/ 5 mgr
  3461. 1/ 5 mgrc
  3462. 1/ 5 dpdk
  3463. 1/ 5 eventtrace
  3464. 1/ 5 prioritycache
  3465. -2/-2 (syslog threshold)
  3466. -1/-1 (stderr threshold)
  3467. max_recent 10000
  3468. max_new 1000
  3469. log_file /var/log/ceph/ceph-osd.11.log
  3470. --- end dump of recent events ---
  3471. 2020-12-12 20:23:42.100 7f2d2dee6c80 0 set uid:gid to 64045:64045 (ceph:ceph)
  3472. 2020-12-12 20:23:42.100 7f2d2dee6c80 0 ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable), process ceph-osd, pid 797471
  3473. 2020-12-12 20:23:42.100 7f2d2dee6c80 0 pidfile_write: ignore empty --pid-file
  3474. 2020-12-12 20:23:42.100 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  3475. 2020-12-12 20:23:42.100 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  3476. 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3477. 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  3478. 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  3479. 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev(0x559196da2e00 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  3480. 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev(0x559196da2e00 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3481. 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  3482. 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  3483. 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev(0x559196da3180 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  3484. 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev(0x559196da3180 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3485. 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  3486. 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev(0x559196da2e00 /var/lib/ceph/osd/ceph-11/block.db) close
  3487. 2020-12-12 20:23:42.400 7f2d2dee6c80 1 bdev(0x559196da3180 /var/lib/ceph/osd/ceph-11/block) close
  3488. 2020-12-12 20:23:42.652 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) close
  3489. 2020-12-12 20:23:42.884 7f2d2dee6c80 0 starting osd.11 osd_data /var/lib/ceph/osd/ceph-11 /var/lib/ceph/osd/ceph-11/journal
  3490. 2020-12-12 20:23:42.896 7f2d2dee6c80 0 load: jerasure load: lrc load: isa
  3491. 2020-12-12 20:23:42.896 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  3492. 2020-12-12 20:23:42.896 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  3493. 2020-12-12 20:23:42.896 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3494. 2020-12-12 20:23:42.896 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  3495. 2020-12-12 20:23:42.896 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) close
  3496. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _mount path /var/lib/ceph/osd/ceph-11
  3497. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  3498. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  3499. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3500. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  3501. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  3502. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev(0x559196da3880 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  3503. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev(0x559196da3880 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3504. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  3505. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  3506. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev(0x559196da3500 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  3507. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev(0x559196da3500 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3508. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  3509. 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option compaction_readahead_size = 2097152
  3510. 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option compression = kNoCompression
  3511. 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option max_background_compactions = 2
  3512. 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option max_write_buffer_number = 4
  3513. 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  3514. 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option recycle_log_file_num = 4
  3515. 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option writable_file_max_buffer_size = 0
  3516. 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option write_buffer_size = 268435456
  3517. 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bluefs mount
  3518. 2020-12-12 20:23:43.180 7f2d2dee6c80 1 bluefs _init_alloc id 1 alloc_size 0x100000 size 0x14c8500000
  3519. 2020-12-12 20:23:43.180 7f2d2dee6c80 1 bluefs _init_alloc id 2 alloc_size 0x10000 size 0x3a381400000
  3520. 2020-12-12 20:23:43.208 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db set db_paths to db,84797030400 db.slow,3800743857356
  3521. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option compaction_readahead_size = 2097152
  3522. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option compression = kNoCompression
  3523. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option max_background_compactions = 2
  3524. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option max_write_buffer_number = 4
  3525. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  3526. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option recycle_log_file_num = 4
  3527. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option writable_file_max_buffer_size = 0
  3528. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option write_buffer_size = 268435456
  3529. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option compaction_readahead_size = 2097152
  3530. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option compression = kNoCompression
  3531. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option max_background_compactions = 2
  3532. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option max_write_buffer_number = 4
  3533. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  3534. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option recycle_log_file_num = 4
  3535. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option writable_file_max_buffer_size = 0
  3536. 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option write_buffer_size = 268435456
  3537. 2020-12-12 20:23:43.212 7f2d2dee6c80 1 rocksdb: do_open column families: [default]
  3538. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: RocksDB version: 6.1.2
  3539.  
  3540. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  3541. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Compile date Dec 2 2020
  3542. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: DB SUMMARY
  3543.  
  3544. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: CURRENT file: CURRENT
  3545.  
  3546. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: IDENTITY file: IDENTITY
  3547.  
  3548. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: MANIFEST file: MANIFEST-003622 size: 6029 Bytes
  3549.  
  3550. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: SST files in db dir, Total Num: 47, files: 000199.sst 000264.sst 000265.sst 000340.sst 000341.sst 000342.sst 000343.sst 000345.sst 000346.sst
  3551.  
  3552. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
  3553.  
  3554. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Write Ahead Log file in db.wal: 003623.log size: 0 ;
  3555.  
  3556. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.error_if_exists: 0
  3557. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.create_if_missing: 0
  3558. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.paranoid_checks: 1
  3559. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.env: 0x559196e56d40
  3560. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.info_log: 0x559196e57760
  3561. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_file_opening_threads: 16
  3562. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.statistics: (nil)
  3563. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.use_fsync: 0
  3564. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_log_file_size: 0
  3565. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
  3566. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.log_file_time_to_roll: 0
  3567. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.keep_log_file_num: 1000
  3568. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.recycle_log_file_num: 4
  3569. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.allow_fallocate: 1
  3570. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.allow_mmap_reads: 0
  3571. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.allow_mmap_writes: 0
  3572. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.use_direct_reads: 0
  3573. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  3574. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.create_missing_column_families: 0
  3575. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.db_log_dir:
  3576. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.wal_dir: db.wal
  3577. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.table_cache_numshardbits: 6
  3578. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_subcompactions: 1
  3579. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_background_flushes: -1
  3580. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.WAL_ttl_seconds: 0
  3581. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.WAL_size_limit_MB: 0
  3582. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
  3583. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.is_fd_close_on_exec: 1
  3584. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.advise_random_on_open: 1
  3585. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.db_write_buffer_size: 0
  3586. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.write_buffer_manager: 0x559196f4ade0
  3587. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
  3588. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  3589. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  3590. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.use_adaptive_mutex: 0
  3591. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.rate_limiter: (nil)
  3592. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  3593. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.wal_recovery_mode: 0
  3594. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.enable_thread_tracking: 0
  3595. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.enable_pipelined_write: 0
  3596. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  3597. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  3598. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
  3599. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  3600. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.row_cache: None
  3601. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.wal_filter: None
  3602. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
  3603. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.allow_ingest_behind: 0
  3604. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.preserve_deletes: 0
  3605. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.two_write_queues: 0
  3606. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.manual_wal_flush: 0
  3607. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.atomic_flush: 0
  3608. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  3609. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_background_jobs: 2
  3610. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_background_compactions: 2
  3611. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  3612. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.writable_file_max_buffer_size: 0
  3613. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.delayed_write_rate : 16777216
  3614. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_total_wal_size: 0
  3615. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  3616. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.stats_dump_period_sec: 600
  3617. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.stats_persist_period_sec: 600
  3618. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
  3619. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_open_files: -1
  3620. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bytes_per_sync: 0
  3621. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.wal_bytes_per_sync: 0
  3622. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_readahead_size: 2097152
  3623. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Compression algorithms supported:
  3624. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
  3625. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kZSTD supported: 0
  3626. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kXpressCompression supported: 0
  3627. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kLZ4HCCompression supported: 1
  3628. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kLZ4Compression supported: 1
  3629. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kBZip2Compression supported: 0
  3630. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kZlibCompression supported: 1
  3631. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kSnappyCompression supported: 1
  3632. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Fast CRC32 supported: Supported on x86
  3633. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: [db/db_impl_readonly.cc:22] Opening the db in read only mode
  3634. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-003622
  3635.  
  3636. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  3637.  
  3638. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  3639. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  3640. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_filter: None
  3641. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_filter_factory: None
  3642. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.memtable_factory: SkipListFactory
  3643. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.table_factory: BlockBasedTable
  3644. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5591961c6220)
  3645. cache_index_and_filter_blocks: 1
  3646. cache_index_and_filter_blocks_with_high_priority: 1
  3647. pin_l0_filter_and_index_blocks_in_cache: 0
  3648. pin_top_level_index_and_filter: 1
  3649. index_type: 0
  3650. data_block_index_type: 0
  3651. data_block_hash_table_util_ratio: 0.750000
  3652. hash_index_allow_collision: 1
  3653. checksum: 1
  3654. no_block_cache: 0
  3655. block_cache: 0x559196114a10
  3656. block_cache_name: BinnedLRUCache
  3657. block_cache_options:
  3658. capacity : 429496729
  3659. num_shard_bits : 4
  3660. strict_capacity_limit : 0
  3661. high_pri_pool_ratio: 0.000
  3662. block_cache_compressed: (nil)
  3663. persistent_cache: (nil)
  3664. block_size: 4096
  3665. block_size_deviation: 10
  3666. block_restart_interval: 16
  3667. index_block_restart_interval: 1
  3668. metadata_block_size: 4096
  3669. partition_filters: 0
  3670. use_delta_encoding: 1
  3671. filter_policy: rocksdb.BuiltinBloomFilter
  3672. whole_key_filtering: 1
  3673. verify_compression: 0
  3674. read_amp_bytes_per_bit: 0
  3675. format_version: 2
  3676. enable_index_compression: 1
  3677. block_align: 0
  3678.  
  3679. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.write_buffer_size: 268435456
  3680. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_write_buffer_number: 4
  3681. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression: NoCompression
  3682. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression: Disabled
  3683. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.prefix_extractor: nullptr
  3684. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  3685. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.num_levels: 7
  3686. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  3687. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  3688. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  3689. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  3690. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  3691. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  3692. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  3693. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  3694. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression_opts.window_bits: -14
  3695. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression_opts.level: 32767
  3696. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression_opts.strategy: 0
  3697. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  3698. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  3699. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression_opts.enabled: false
  3700. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  3701. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  3702. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
  3703. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.target_file_size_base: 67108864
  3704. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.target_file_size_multiplier: 1
  3705. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  3706. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  3707. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  3708. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  3709. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  3710. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  3711. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  3712. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  3713. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  3714. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  3715. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  3716. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
  3717. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.arena_block_size: 33554432
  3718. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  3719. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  3720. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  3721. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.disable_auto_compactions: 0
  3722. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  3723. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  3724. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  3725. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  3726. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  3727. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  3728. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  3729. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  3730. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  3731. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  3732. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.table_properties_collectors:
  3733. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.inplace_update_support: 0
  3734. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.inplace_update_num_locks: 10000
  3735. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  3736. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
  3737. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.memtable_huge_page_size: 0
  3738. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bloom_locality: 0
  3739. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_successive_merges: 0
  3740. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.optimize_filters_for_hits: 0
  3741. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.paranoid_file_checks: 0
  3742. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.force_consistency_checks: 0
  3743. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.report_bg_io_stats: 0
  3744. 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.ttl: 0
  3745. 2020-12-12 20:23:43.216 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-003622 succeeded,manifest_file_number is 3622, next_file_number is 3624, last_sequence is 22382894, log_number is 3621,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  3746.  
  3747. 2020-12-12 20:23:43.216 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 3621
  3748.  
  3749. 2020-12-12 20:23:43.216 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023218647, "job": 1, "event": "recovery_started", "log_files": [3623]}
  3750. 2020-12-12 20:23:43.216 7f2d2dee6c80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3623 mode 0
  3751. 2020-12-12 20:23:43.216 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023218669, "job": 1, "event": "recovery_finished"}
  3752. 2020-12-12 20:23:43.216 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  3753. 2020-12-12 20:23:43.220 7f2d2dee6c80 1 freelist init
  3754. 2020-12-12 20:23:43.224 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_alloc opening allocation metadata
  3755. 2020-12-12 20:23:43.380 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_alloc loaded 2.3 TiB in 139875 extents available 2.2 TiB
  3756. 2020-12-12 20:23:43.380 7f2d2dee6c80 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work
  3757. 2020-12-12 20:23:43.380 7f2d2dee6c80 4 rocksdb: [db/db_impl.cc:563] Shutdown complete
  3758. 2020-12-12 20:23:43.380 7f2d2dee6c80 1 bluefs umount
  3759. 2020-12-12 20:23:43.380 7f2d2dee6c80 1 bdev(0x559196da3880 /var/lib/ceph/osd/ceph-11/block.db) close
  3760. 2020-12-12 20:23:43.468 7f2d2dee6c80 1 bdev(0x559196da3500 /var/lib/ceph/osd/ceph-11/block) close
  3761. 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  3762. 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bdev(0x559196da3500 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  3763. 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bdev(0x559196da3500 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  3764. 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  3765. 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  3766. 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bdev(0x559196da3880 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  3767. 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bdev(0x559196da3880 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  3768. 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  3769. 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option compaction_readahead_size = 2097152
  3770. 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option compression = kNoCompression
  3771. 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option max_background_compactions = 2
  3772. 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option max_write_buffer_number = 4
  3773. 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  3774. 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option recycle_log_file_num = 4
  3775. 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option writable_file_max_buffer_size = 0
  3776. 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option write_buffer_size = 268435456
  3777. 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bluefs mount
  3778. 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bluefs _init_alloc id 1 alloc_size 0x100000 size 0x14c8500000
  3779. 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bluefs _init_alloc id 2 alloc_size 0x10000 size 0x3a381400000
  3780. 2020-12-12 20:23:43.776 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db set db_paths to db,84797030400 db.slow,3800743857356
  3781. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option compaction_readahead_size = 2097152
  3782. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option compression = kNoCompression
  3783. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option max_background_compactions = 2
  3784. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option max_write_buffer_number = 4
  3785. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  3786. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option recycle_log_file_num = 4
  3787. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option writable_file_max_buffer_size = 0
  3788. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option write_buffer_size = 268435456
  3789. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option compaction_readahead_size = 2097152
  3790. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option compression = kNoCompression
  3791. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option max_background_compactions = 2
  3792. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option max_write_buffer_number = 4
  3793. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  3794. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option recycle_log_file_num = 4
  3795. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option writable_file_max_buffer_size = 0
  3796. 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option write_buffer_size = 268435456
  3797. 2020-12-12 20:23:43.776 7f2d2dee6c80 1 rocksdb: do_open column families: [default]
  3798. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: RocksDB version: 6.1.2
  3799.  
  3800. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  3801. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Compile date Dec 2 2020
  3802. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: DB SUMMARY
  3803.  
  3804. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: CURRENT file: CURRENT
  3805.  
  3806. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: IDENTITY file: IDENTITY
  3807.  
  3808. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: MANIFEST file: MANIFEST-003622 size: 6029 Bytes
  3809.  
  3810. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: SST files in db dir, Total Num: 47, files: 000199.sst 000264.sst 000265.sst 000340.sst 000341.sst 000342.sst 000343.sst 000345.sst 000346.sst
  3811.  
  3812. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
  3813.  
  3814. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Write Ahead Log file in db.wal: 003623.log size: 0 ;
  3815.  
  3816. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.error_if_exists: 0
  3817. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.create_if_missing: 0
  3818. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.paranoid_checks: 1
  3819. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.env: 0x559196e57140
  3820. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.info_log: 0x559198086f40
  3821. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_file_opening_threads: 16
  3822. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.statistics: (nil)
  3823. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.use_fsync: 0
  3824. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_log_file_size: 0
  3825. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
  3826. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.log_file_time_to_roll: 0
  3827. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.keep_log_file_num: 1000
  3828. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.recycle_log_file_num: 4
  3829. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.allow_fallocate: 1
  3830. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.allow_mmap_reads: 0
  3831. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.allow_mmap_writes: 0
  3832. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.use_direct_reads: 0
  3833. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  3834. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.create_missing_column_families: 0
  3835. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.db_log_dir:
  3836. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.wal_dir: db.wal
  3837. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.table_cache_numshardbits: 6
  3838. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_subcompactions: 1
  3839. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_background_flushes: -1
  3840. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.WAL_ttl_seconds: 0
  3841. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.WAL_size_limit_MB: 0
  3842. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
  3843. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.is_fd_close_on_exec: 1
  3844. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.advise_random_on_open: 1
  3845. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.db_write_buffer_size: 0
  3846. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.write_buffer_manager: 0x559196f4be60
  3847. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
  3848. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  3849. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  3850. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.use_adaptive_mutex: 0
  3851. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.rate_limiter: (nil)
  3852. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  3853. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.wal_recovery_mode: 0
  3854. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.enable_thread_tracking: 0
  3855. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.enable_pipelined_write: 0
  3856. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  3857. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  3858. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
  3859. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  3860. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.row_cache: None
  3861. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.wal_filter: None
  3862. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
  3863. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.allow_ingest_behind: 0
  3864. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.preserve_deletes: 0
  3865. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.two_write_queues: 0
  3866. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.manual_wal_flush: 0
  3867. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.atomic_flush: 0
  3868. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  3869. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_background_jobs: 2
  3870. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_background_compactions: 2
  3871. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  3872. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.writable_file_max_buffer_size: 0
  3873. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.delayed_write_rate : 16777216
  3874. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_total_wal_size: 0
  3875. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  3876. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.stats_dump_period_sec: 600
  3877. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.stats_persist_period_sec: 600
  3878. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
  3879. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_open_files: -1
  3880. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bytes_per_sync: 0
  3881. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.wal_bytes_per_sync: 0
  3882. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_readahead_size: 2097152
  3883. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Compression algorithms supported:
  3884. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
  3885. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kZSTD supported: 0
  3886. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kXpressCompression supported: 0
  3887. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kLZ4HCCompression supported: 1
  3888. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kLZ4Compression supported: 1
  3889. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kBZip2Compression supported: 0
  3890. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kZlibCompression supported: 1
  3891. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kSnappyCompression supported: 1
  3892. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Fast CRC32 supported: Supported on x86
  3893. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-003622
  3894.  
  3895. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  3896.  
  3897. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  3898. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  3899. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_filter: None
  3900. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_filter_factory: None
  3901. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.memtable_factory: SkipListFactory
  3902. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.table_factory: BlockBasedTable
  3903. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5591960cb210)
  3904. cache_index_and_filter_blocks: 1
  3905. cache_index_and_filter_blocks_with_high_priority: 1
  3906. pin_l0_filter_and_index_blocks_in_cache: 0
  3907. pin_top_level_index_and_filter: 1
  3908. index_type: 0
  3909. data_block_index_type: 0
  3910. data_block_hash_table_util_ratio: 0.750000
  3911. hash_index_allow_collision: 1
  3912. checksum: 1
  3913. no_block_cache: 0
  3914. block_cache: 0x559196114910
  3915. block_cache_name: BinnedLRUCache
  3916. block_cache_options:
  3917. capacity : 429496729
  3918. num_shard_bits : 4
  3919. strict_capacity_limit : 0
  3920. high_pri_pool_ratio: 0.000
  3921. block_cache_compressed: (nil)
  3922. persistent_cache: (nil)
  3923. block_size: 4096
  3924. block_size_deviation: 10
  3925. block_restart_interval: 16
  3926. index_block_restart_interval: 1
  3927. metadata_block_size: 4096
  3928. partition_filters: 0
  3929. use_delta_encoding: 1
  3930. filter_policy: rocksdb.BuiltinBloomFilter
  3931. whole_key_filtering: 1
  3932. verify_compression: 0
  3933. read_amp_bytes_per_bit: 0
  3934. format_version: 2
  3935. enable_index_compression: 1
  3936. block_align: 0
  3937.  
  3938. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.write_buffer_size: 268435456
  3939. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_write_buffer_number: 4
  3940. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression: NoCompression
  3941. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression: Disabled
  3942. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.prefix_extractor: nullptr
  3943. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  3944. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.num_levels: 7
  3945. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  3946. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  3947. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  3948. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  3949. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  3950. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  3951. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  3952. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  3953. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression_opts.window_bits: -14
  3954. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression_opts.level: 32767
  3955. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression_opts.strategy: 0
  3956. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  3957. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  3958. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression_opts.enabled: false
  3959. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  3960. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  3961. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
  3962. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.target_file_size_base: 67108864
  3963. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.target_file_size_multiplier: 1
  3964. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  3965. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  3966. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  3967. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  3968. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  3969. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  3970. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  3971. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  3972. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  3973. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  3974. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  3975. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
  3976. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.arena_block_size: 33554432
  3977. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  3978. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  3979. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  3980. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.disable_auto_compactions: 0
  3981. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  3982. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  3983. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  3984. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  3985. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  3986. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  3987. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  3988. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  3989. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  3990. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  3991. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.table_properties_collectors:
  3992. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.inplace_update_support: 0
  3993. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.inplace_update_num_locks: 10000
  3994. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  3995. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
  3996. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.memtable_huge_page_size: 0
  3997. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bloom_locality: 0
  3998. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_successive_merges: 0
  3999. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.optimize_filters_for_hits: 0
  4000. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.paranoid_file_checks: 0
  4001. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.force_consistency_checks: 0
  4002. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.report_bg_io_stats: 0
  4003. 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.ttl: 0
  4004. 2020-12-12 20:23:43.780 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-003622 succeeded,manifest_file_number is 3622, next_file_number is 3624, last_sequence is 22382894, log_number is 3621,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  4005.  
  4006. 2020-12-12 20:23:43.780 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 3621
  4007.  
  4008. 2020-12-12 20:23:43.780 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023785737, "job": 1, "event": "recovery_started", "log_files": [3623]}
  4009. 2020-12-12 20:23:43.780 7f2d2dee6c80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3623 mode 0
  4010. 2020-12-12 20:23:43.780 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3036] Creating manifest 3625
  4011.  
  4012. 2020-12-12 20:23:43.784 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023787624, "job": 1, "event": "recovery_finished"}
  4013. 2020-12-12 20:23:43.784 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023787757, "job": 2, "event": "table_file_deletion", "file_number": 3629}
  4014. 2020-12-12 20:23:43.784 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023787775, "job": 2, "event": "table_file_deletion", "file_number": 3628}
  4015. 2020-12-12 20:23:43.784 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023787782, "job": 2, "event": "table_file_deletion", "file_number": 3627}
  4016. 2020-12-12 20:23:43.784 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023787788, "job": 2, "event": "table_file_deletion", "file_number": 3626}
  4017. 2020-12-12 20:23:43.788 7f2d2dee6c80 4 rocksdb: DB pointer 0x559198144000
  4018. 2020-12-12 20:23:43.788 7f2d23408700 4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 3] Compacting 1@1 + 4@2 files to L2, score 1.03
  4019. 2020-12-12 20:23:43.788 7f2d23408700 4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 2 Base level 1, inputs: [449(64MB)], [345(64MB) 346(64MB) 347(64MB) 348(64MB)]
  4020.  
  4021. 2020-12-12 20:23:43.788 7f2d23408700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023790147, "job": 3, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [449], "files_L2": [345, 346, 347, 348], "score": 1.02872, "input_data_size": 338693918}
  4022. 2020-12-12 20:23:43.788 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  4023. 2020-12-12 20:23:43.788 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _upgrade_super from 2, latest 2
  4024. 2020-12-12 20:23:43.788 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _upgrade_super done
  4025. 2020-12-12 20:23:43.788 7f2d1a3f6700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS -------
  4026. 2020-12-12 20:23:43.788 7f2d1a3f6700 4 rocksdb: [db/db_impl.cc:778]
  4027. ** DB Stats **
  4028. Uptime(secs): 0.0 total, 0.0 interval
  4029. Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
  4030. Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
  4031. Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
  4032. Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
  4033. Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
  4034. Interval stall: 00:00:0.000 H:M:S, 0.0 percent
  4035.  
  4036. ** Compaction Stats [default] **
  4037. Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  4038. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  4039. L0 2/0 3.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  4040. L1 4/1 194.65 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  4041. L2 37/4 2.22 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  4042. Sum 43/5 2.41 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  4043. Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  4044.  
  4045. ** Compaction Stats [default] **
  4046. Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  4047. -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  4048. Uptime(secs): 0.0 total, 0.0 interval
  4049. Flush(GB): cumulative 0.000, interval 0.000
  4050. AddFile(GB): cumulative 0.000, interval 0.000
  4051. AddFile(Total Files): cumulative 0, interval 0
  4052. AddFile(L0 Files): cumulative 0, interval 0
  4053. AddFile(Keys): cumulative 0, interval 0
  4054. Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  4055. Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  4056. Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
  4057.  
  4058. ** File Read Latency Histogram By Level [default] **
  4059.  
  4060. ** Compaction Stats [default] **
  4061. Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  4062. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  4063. L0 2/0 3.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  4064. L1 4/1 194.65 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  4065. L2 37/4 2.22 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  4066. Sum 43/5 2.41 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  4067. Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  4068.  
  4069. ** Compaction Stats [default] **
  4070. Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  4071. -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  4072. Uptime(secs): 0.0 total, 0.0 interval
  4073. Flush(GB): cumulative 0.000, interval 0.000
  4074. AddFile(GB): cumulative 0.000, interval 0.000
  4075. AddFile(Total Files): cumulative 0, interval 0
  4076. AddFile(L0 Files): cumulative 0, interval 0
  4077. AddFile(Keys): cumulative 0, interval 0
  4078. Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  4079. Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  4080. Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
  4081.  
  4082. ** File Read Latency Histogram By Level [default] **
  4083.  
  4084. 2020-12-12 20:23:43.840 7f2d2dee6c80 0 _get_class not permitted to load sdk
  4085. 2020-12-12 20:23:43.840 7f2d2dee6c80 0 <cls> /build/ceph/ceph-14.2.15/src/cls/hello/cls_hello.cc:296: loading cls_hello
  4086. 2020-12-12 20:23:43.844 7f2d2dee6c80 0 _get_class not permitted to load lua
  4087. 2020-12-12 20:23:43.848 7f2d2dee6c80 0 _get_class not permitted to load kvs
  4088. 2020-12-12 20:23:43.848 7f2d2dee6c80 0 <cls> /build/ceph/ceph-14.2.15/src/cls/cephfs/cls_cephfs.cc:197: loading cephfs
  4089. 2020-12-12 20:23:43.848 7f2d2dee6c80 0 osd.11 120674 crush map has features 432629308056666112, adjusting msgr requires for clients
  4090. 2020-12-12 20:23:43.848 7f2d2dee6c80 0 osd.11 120674 crush map has features 432629308056666112 was 8705, adjusting msgr requires for mons
  4091. 2020-12-12 20:23:43.848 7f2d2dee6c80 0 osd.11 120674 crush map has features 3314933069573799936, adjusting msgr requires for osds
  4092. 2020-12-12 20:23:44.212 7f2d23408700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3629: 42754 keys, 67717992 bytes
  4093. 2020-12-12 20:23:44.212 7f2d23408700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837024216689, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3629, "file_size": 67717992, "table_properties": {"data_size": 67112720, "index_size": 497464, "filter_size": 106949, "raw_key_size": 2795150, "raw_average_key_size": 65, "raw_value_size": 64371790, "raw_average_value_size": 1505, "num_data_blocks": 14079, "num_entries": 42754, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  4094. 2020-12-12 20:23:44.604 7f2d23408700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3630: 43658 keys, 67732235 bytes
  4095. 2020-12-12 20:23:44.604 7f2d23408700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837024608149, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3630, "file_size": 67732235, "table_properties": {"data_size": 67111811, "index_size": 510312, "filter_size": 109253, "raw_key_size": 3756526, "raw_average_key_size": 86, "raw_value_size": 63462002, "raw_average_value_size": 1453, "num_data_blocks": 14230, "num_entries": 43658, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  4096. 2020-12-12 20:23:45.004 7f2d23408700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3631: 43657 keys, 67729297 bytes
  4097. 2020-12-12 20:23:45.004 7f2d23408700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837025008006, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3631, "file_size": 67729297, "table_properties": {"data_size": 67113092, "index_size": 506093, "filter_size": 109253, "raw_key_size": 3372528, "raw_average_key_size": 77, "raw_value_size": 63853503, "raw_average_value_size": 1462, "num_data_blocks": 14172, "num_entries": 43657, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  4098. 2020-12-12 20:23:45.360 7f2d23408700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3632: 42522 keys, 67713983 bytes
  4099. 2020-12-12 20:23:45.360 7f2d23408700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837025362337, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3632, "file_size": 67713983, "table_properties": {"data_size": 67112021, "index_size": 494666, "filter_size": 106437, "raw_key_size": 2680741, "raw_average_key_size": 63, "raw_value_size": 64464845, "raw_average_value_size": 1516, "num_data_blocks": 14067, "num_entries": 42522, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  4100. 2020-12-12 20:23:45.652 7f2d23408700 3 rocksdb: [db/db_impl_compaction_flush.cc:2660] Compaction error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704
  4101. 2020-12-12 20:23:45.652 7f2d23408700 4 rocksdb: (Original Log Time 2020/12/12-20:23:45.656289) [db/compaction_job.cc:768] [default] compacted to: files[2 4 37 0 0 0 0] max score 0.79, MB/sec: 181.5 rd, 145.2 wr, level 2, files in(1, 4) out(5) MB in(64.7, 258.3) out(258.3), read-write-amplify(9.0) write-amplify(4.0) Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704, records in: 243696, records dropped: 28515 output_compression: NoCompression
  4102.  
  4103. 2020-12-12 20:23:45.652 7f2d23408700 4 rocksdb: (Original Log Time 2020/12/12-20:23:45.656341) EVENT_LOG_v1 {"time_micros": 1607837025656320, "job": 3, "event": "compaction_finished", "compaction_time_micros": 1866083, "compaction_time_cpu_micros": 453800, "output_level": 2, "num_output_files": 5, "total_output_size": 318240797, "num_input_records": 231169, "num_output_records": 202654, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [2, 4, 37, 0, 0, 0, 0]}
  4104. 2020-12-12 20:23:45.652 7f2d23408700 2 rocksdb: [db/db_impl_compaction_flush.cc:2212] Waiting after background compaction error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704, Accumulated background error counts: 1
  4105. 2020-12-12 20:23:45.668 7f2d2dee6c80 0 osd.11 120674 load_pgs
  4106. 2020-12-12 20:23:45.756 7f2d21404700 -1 rocksdb: submit_common error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704 code = 2 Rocksdb transaction:
  4107. Put( Prefix = P key = 0x000000000000146e'.can_rollback_to' Value size = 12)
  4108. Put( Prefix = P key = 0x000000000000146e'.rollback_info_trimmed_to' Value size = 12)
  4109. Put( Prefix = O key = 0x828000000000000013f000000021213dfffffffffffffffeffffffffffffffff'o' Value size = 29)
  4110. Put( Prefix = S key = 'nid_max' Value size = 8)
  4111. Put( Prefix = S key = 'blobid_max' Value size = 8)
  4112. 2020-12-12 20:23:45.756 7f2d21404700 -1 /build/ceph/ceph-14.2.15/src/os/bluestore/BlueStore.cc: In function 'void BlueStore::_kv_sync_thread()' thread 7f2d21404700 time 2020-12-12 20:23:45.759106
  4113. /build/ceph/ceph-14.2.15/src/os/bluestore/BlueStore.cc: 11380: FAILED ceph_assert(r == 0)
  4114.  
  4115. ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable)
  4116. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x55918be53c1e]
  4117. 2: (()+0x513df6) [0x55918be53df6]
  4118. 3: (BlueStore::_kv_sync_thread()+0x1826) [0x55918c3ec766]
  4119. 4: (BlueStore::KVSyncThread::entry()+0xd) [0x55918c4129bd]
  4120. 5: (()+0x7fa3) [0x7f2d2e92afa3]
  4121. 6: (clone()+0x3f) [0x7f2d2e4da4cf]
  4122.  
  4123. 2020-12-12 20:23:45.760 7f2d21404700 -1 *** Caught signal (Aborted) **
  4124. in thread 7f2d21404700 thread_name:bstore_kv_sync
  4125.  
  4126. ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable)
  4127. 1: (()+0x12730) [0x7f2d2e935730]
  4128. 2: (gsignal()+0x10b) [0x7f2d2e4187bb]
  4129. 3: (abort()+0x121) [0x7f2d2e403535]
  4130. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x55918be53c6f]
  4131. 5: (()+0x513df6) [0x55918be53df6]
  4132. 6: (BlueStore::_kv_sync_thread()+0x1826) [0x55918c3ec766]
  4133. 7: (BlueStore::KVSyncThread::entry()+0xd) [0x55918c4129bd]
  4134. 8: (()+0x7fa3) [0x7f2d2e92afa3]
  4135. 9: (clone()+0x3f) [0x7f2d2e4da4cf]
  4136. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  4137.  
  4138. --- begin dump of recent events ---
  4139. -765> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command assert hook 0x5591960cc110
  4140. -764> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command abort hook 0x5591960cc110
  4141. -763> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command perfcounters_dump hook 0x5591960cc110
  4142. -762> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command 1 hook 0x5591960cc110
  4143. -761> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command perf dump hook 0x5591960cc110
  4144. -760> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command perfcounters_schema hook 0x5591960cc110
  4145. -759> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command perf histogram dump hook 0x5591960cc110
  4146. -758> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command 2 hook 0x5591960cc110
  4147. -757> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command perf schema hook 0x5591960cc110
  4148. -756> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command perf histogram schema hook 0x5591960cc110
  4149. -755> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command perf reset hook 0x5591960cc110
  4150. -754> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command config show hook 0x5591960cc110
  4151. -753> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command config help hook 0x5591960cc110
  4152. -752> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command config set hook 0x5591960cc110
  4153. -751> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command config unset hook 0x5591960cc110
  4154. -750> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command config get hook 0x5591960cc110
  4155. -749> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command config diff hook 0x5591960cc110
  4156. -748> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command config diff get hook 0x5591960cc110
  4157. -747> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command log flush hook 0x5591960cc110
  4158. -746> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command log dump hook 0x5591960cc110
  4159. -745> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command log reopen hook 0x5591960cc110
  4160. -744> 2020-12-12 20:23:42.092 7f2d2dee6c80 5 asok(0x55919616a000) register_command dump_mempools hook 0x559196d68068
  4161. -743> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient: get_monmap_and_config
  4162. -742> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient: build_initial_monmap
  4163. -741> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient: monmap:
  4164. epoch 0
  4165. fsid d0b4c175-02ba-4a64-8040-eb163002cba6
  4166. last_changed 2020-12-12 20:23:42.099843
  4167. created 2020-12-12 20:23:42.099843
  4168. min_mon_release 0 (unknown)
  4169. 0: v1:192.168.8.100:6789/0 mon.noname-a-legacy
  4170. 1: v1:192.168.8.101:6789/0 mon.noname-c-legacy
  4171. 2: v1:192.168.8.102:6789/0 mon.noname-b-legacy
  4172. 3: v2:192.168.8.100:3300/0 mon.noname-a
  4173. 4: v2:192.168.8.101:3300/0 mon.noname-c
  4174. 5: v2:192.168.8.102:3300/0 mon.noname-b
  4175.  
  4176. -740> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding auth protocol: cephx
  4177. -739> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding auth protocol: cephx
  4178. -738> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding auth protocol: cephx
  4179. -737> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: secure
  4180. -736> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: crc
  4181. -735> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: secure
  4182. -734> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: crc
  4183. -733> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: secure
  4184. -732> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: crc
  4185. -731> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: crc
  4186. -730> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: secure
  4187. -729> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: crc
  4188. -728> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: secure
  4189. -727> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: crc
  4190. -726> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: secure
  4191. -725> 2020-12-12 20:23:42.096 7f2d2dee6c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  4192. -724> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient: init
  4193. -723> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding auth protocol: cephx
  4194. -722> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding auth protocol: cephx
  4195. -721> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding auth protocol: cephx
  4196. -720> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding con mode: secure
  4197. -719> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding con mode: crc
  4198. -718> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding con mode: secure
  4199. -717> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding con mode: crc
  4200. -716> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding con mode: secure
  4201. -715> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding con mode: crc
  4202. -714> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding con mode: crc
  4203. -713> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding con mode: secure
  4204. -712> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding con mode: crc
  4205. -711> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding con mode: secure
  4206. -710> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding con mode: crc
  4207. -709> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 AuthRegistry(0x7ffd53d67bf8) adding con mode: secure
  4208. -708> 2020-12-12 20:23:42.096 7f2d2dee6c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  4209. -707> 2020-12-12 20:23:42.096 7f2d2dee6c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  4210. -706> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient: _reopen_session rank -1
  4211. -705> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient(hunting): picked mon.noname-c con 0x559196163b00 addr v2:192.168.8.101:3300/0
  4212. -704> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient(hunting): picked mon.noname-a con 0x559196163f80 addr v2:192.168.8.100:3300/0
  4213. -703> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient(hunting): picked mon.noname-b con 0x559196164400 addr v2:192.168.8.102:3300/0
  4214. -702> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient(hunting): start opening mon connection
  4215. -701> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient(hunting): start opening mon connection
  4216. -700> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient(hunting): start opening mon connection
  4217. -699> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient(hunting): _renew_subs
  4218. -698> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient(hunting): authenticate will time out at 2020-12-12 20:28:42.100886
  4219. -697> 2020-12-12 20:23:42.096 7f2d2dcad700 10 monclient(hunting): get_auth_request con 0x559196164400 auth_method 0
  4220. -696> 2020-12-12 20:23:42.096 7f2d2dcad700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2]
  4221. -695> 2020-12-12 20:23:42.096 7f2d2dcad700 10 monclient(hunting): _init_auth method 2
  4222. -694> 2020-12-12 20:23:42.096 7f2d2dcad700 10 monclient(hunting): handle_auth_reply_more payload 9
  4223. -693> 2020-12-12 20:23:42.096 7f2d2dcad700 10 monclient(hunting): handle_auth_reply_more payload_len 9
  4224. -692> 2020-12-12 20:23:42.096 7f2d2dcad700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
  4225. -691> 2020-12-12 20:23:42.096 7f2d2dcad700 10 monclient(hunting): handle_auth_done global_id 93709126 payload 386
  4226. -690> 2020-12-12 20:23:42.096 7f2d2dcad700 10 monclient: _finish_hunting 0
  4227. -689> 2020-12-12 20:23:42.096 7f2d2dcad700 1 monclient: found mon.noname-b
  4228. -688> 2020-12-12 20:23:42.096 7f2d2dcad700 10 monclient: _send_mon_message to mon.noname-b at v2:192.168.8.102:3300/0
  4229. -687> 2020-12-12 20:23:42.096 7f2d2c4aa700 10 monclient: handle_monmap mon_map magic: 0 v1
  4230. -686> 2020-12-12 20:23:42.096 7f2d2c4aa700 10 monclient: got monmap 11 from mon.noname-b (according to old e11)
  4231. -685> 2020-12-12 20:23:42.096 7f2d2c4aa700 10 monclient: dump:
  4232. epoch 11
  4233. fsid d0b4c175-02ba-4a64-8040-eb163002cba6
  4234. last_changed 2020-12-05 09:42:18.637201
  4235. created 2020-04-05 17:40:47.148501
  4236. min_mon_release 14 (nautilus)
  4237. 0: [v2:192.168.8.100:3300/0,v1:192.168.8.100:6789/0] mon.sumib
  4238. 1: [v2:192.168.8.102:3300/0,v1:192.168.8.102:6789/0] mon.tower1
  4239. 2: [v2:192.168.8.101:3300/0,v1:192.168.8.101:6789/0] mon.sumia
  4240.  
  4241. -684> 2020-12-12 20:23:42.096 7f2d2c4aa700 10 monclient: _finish_auth 0
  4242. -683> 2020-12-12 20:23:42.096 7f2d2c4aa700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2020-12-12 20:23:12.101635)
  4243. -682> 2020-12-12 20:23:42.096 7f2d2c4aa700 10 monclient: _send_mon_message to mon.tower1 at v2:192.168.8.102:3300/0
  4244. -681> 2020-12-12 20:23:42.096 7f2d2dee6c80 5 monclient: authenticate success, global_id 93709126
  4245. -680> 2020-12-12 20:23:42.096 7f2d2c4aa700 10 monclient: handle_config config(9 keys) v1
  4246. -679> 2020-12-12 20:23:42.096 7f2d2c4aa700 10 monclient: handle_monmap mon_map magic: 0 v1
  4247. -678> 2020-12-12 20:23:42.096 7f2d2c4aa700 10 monclient: got monmap 11 from mon.tower1 (according to old e11)
  4248. -677> 2020-12-12 20:23:42.096 7f2d2aca7700 4 set_mon_vals no callback set
  4249. -676> 2020-12-12 20:23:42.096 7f2d2aca7700 10 set_mon_vals device_failure_prediction_mode = none
  4250. -675> 2020-12-12 20:23:42.096 7f2d2c4aa700 10 monclient: dump:
  4251. epoch 11
  4252. fsid d0b4c175-02ba-4a64-8040-eb163002cba6
  4253. last_changed 2020-12-05 09:42:18.637201
  4254. created 2020-04-05 17:40:47.148501
  4255. min_mon_release 14 (nautilus)
  4256. 0: [v2:192.168.8.100:3300/0,v1:192.168.8.100:6789/0] mon.sumib
  4257. 1: [v2:192.168.8.102:3300/0,v1:192.168.8.102:6789/0] mon.tower1
  4258. 2: [v2:192.168.8.101:3300/0,v1:192.168.8.101:6789/0] mon.sumia
  4259.  
  4260. -674> 2020-12-12 20:23:42.096 7f2d2aca7700 10 set_mon_vals mon_max_pg_per_osd = 272
  4261. -673> 2020-12-12 20:23:42.096 7f2d2aca7700 10 set_mon_vals mon_target_pg_per_osd = 100
  4262. -672> 2020-12-12 20:23:42.096 7f2d2aca7700 10 set_mon_vals osd_pool_default_pg_autoscale_mode = on
  4263. -671> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient: get_monmap_and_config success
  4264. -670> 2020-12-12 20:23:42.096 7f2d2dee6c80 10 monclient: shutdown
  4265. -669> 2020-12-12 20:23:42.096 7f2d2aca7700 10 set_mon_vals osd_recovery_max_active = 3
  4266. -668> 2020-12-12 20:23:42.096 7f2d2aca7700 10 set_mon_vals osd_recovery_max_single_start = 1
  4267. -667> 2020-12-12 20:23:42.096 7f2d2aca7700 10 set_mon_vals osd_recovery_sleep = 0.000000
  4268. -666> 2020-12-12 20:23:42.096 7f2d2aca7700 10 set_mon_vals osd_scrub_auto_repair = true
  4269. -665> 2020-12-12 20:23:42.100 7f2d2dee6c80 0 set uid:gid to 64045:64045 (ceph:ceph)
  4270. -664> 2020-12-12 20:23:42.100 7f2d2dee6c80 0 ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable), process ceph-osd, pid 797471
  4271. -663> 2020-12-12 20:23:42.100 7f2d2dee6c80 0 pidfile_write: ignore empty --pid-file
  4272. -662> 2020-12-12 20:23:42.100 7f2d2dee6c80 5 asok(0x55919616a000) init /var/run/ceph/ceph-osd.11.asok
  4273. -661> 2020-12-12 20:23:42.100 7f2d2dee6c80 5 asok(0x55919616a000) bind_and_listen /var/run/ceph/ceph-osd.11.asok
  4274. -660> 2020-12-12 20:23:42.100 7f2d2dee6c80 5 asok(0x55919616a000) register_command 0 hook 0x5591960cb8d0
  4275. -659> 2020-12-12 20:23:42.100 7f2d2dee6c80 5 asok(0x55919616a000) register_command version hook 0x5591960cb8d0
  4276. -658> 2020-12-12 20:23:42.100 7f2d2dee6c80 5 asok(0x55919616a000) register_command git_version hook 0x5591960cb8d0
  4277. -657> 2020-12-12 20:23:42.100 7f2d2dee6c80 5 asok(0x55919616a000) register_command help hook 0x5591960cc180
  4278. -656> 2020-12-12 20:23:42.100 7f2d2dee6c80 5 asok(0x55919616a000) register_command get_command_descriptions hook 0x5591960cc1d0
  4279. -655> 2020-12-12 20:23:42.100 7f2d2dee6c80 5 object store type is bluestore
  4280. -654> 2020-12-12 20:23:42.100 7f2d2b4a8700 5 asok(0x55919616a000) entry start
  4281. -653> 2020-12-12 20:23:42.100 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  4282. -652> 2020-12-12 20:23:42.100 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  4283. -651> 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4284. -650> 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  4285. -649> 2020-12-12 20:23:42.104 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore bluefs available hook 0x5591960cc760
  4286. -648> 2020-12-12 20:23:42.104 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore bluefs stats hook 0x5591960cc760
  4287. -647> 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  4288. -646> 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev(0x559196da2e00 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  4289. -645> 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev(0x559196da2e00 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4290. -644> 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  4291. -643> 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  4292. -642> 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev(0x559196da3180 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  4293. -641> 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev(0x559196da3180 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4294. -640> 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  4295. -639> 2020-12-12 20:23:42.104 7f2d2dee6c80 5 asok(0x55919616a000) unregister_commands bluestore bluefs available
  4296. -638> 2020-12-12 20:23:42.104 7f2d2dee6c80 5 asok(0x55919616a000) unregister_commands bluestore bluefs stats
  4297. -637> 2020-12-12 20:23:42.104 7f2d2dee6c80 1 bdev(0x559196da2e00 /var/lib/ceph/osd/ceph-11/block.db) close
  4298. -636> 2020-12-12 20:23:42.400 7f2d2dee6c80 1 bdev(0x559196da3180 /var/lib/ceph/osd/ceph-11/block) close
  4299. -635> 2020-12-12 20:23:42.652 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) close
  4300. -634> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding auth protocol: cephx
  4301. -633> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding auth protocol: cephx
  4302. -632> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding auth protocol: cephx
  4303. -631> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: secure
  4304. -630> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: crc
  4305. -629> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: secure
  4306. -628> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: crc
  4307. -627> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: secure
  4308. -626> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: crc
  4309. -625> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: crc
  4310. -624> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: secure
  4311. -623> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: crc
  4312. -622> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: secure
  4313. -621> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: crc
  4314. -620> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46140) adding con mode: secure
  4315. -619> 2020-12-12 20:23:42.884 7f2d2dee6c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  4316. -618> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding auth protocol: cephx
  4317. -617> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding auth protocol: cephx
  4318. -616> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding auth protocol: cephx
  4319. -615> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding con mode: secure
  4320. -614> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding con mode: crc
  4321. -613> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding con mode: secure
  4322. -612> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding con mode: crc
  4323. -611> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding con mode: secure
  4324. -610> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding con mode: crc
  4325. -609> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding con mode: crc
  4326. -608> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding con mode: secure
  4327. -607> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding con mode: crc
  4328. -606> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding con mode: secure
  4329. -605> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding con mode: crc
  4330. -604> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d46a40) adding con mode: secure
  4331. -603> 2020-12-12 20:23:42.884 7f2d2dee6c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  4332. -602> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding auth protocol: cephx
  4333. -601> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding auth protocol: cephx
  4334. -600> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding auth protocol: cephx
  4335. -599> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding con mode: secure
  4336. -598> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding con mode: crc
  4337. -597> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding con mode: secure
  4338. -596> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding con mode: crc
  4339. -595> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding con mode: secure
  4340. -594> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding con mode: crc
  4341. -593> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding con mode: crc
  4342. -592> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding con mode: secure
  4343. -591> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding con mode: crc
  4344. -590> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding con mode: secure
  4345. -589> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding con mode: crc
  4346. -588> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47340) adding con mode: secure
  4347. -587> 2020-12-12 20:23:42.884 7f2d2dee6c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  4348. -586> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding auth protocol: cephx
  4349. -585> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding auth protocol: cephx
  4350. -584> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding auth protocol: cephx
  4351. -583> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding con mode: secure
  4352. -582> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding con mode: crc
  4353. -581> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding con mode: secure
  4354. -580> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding con mode: crc
  4355. -579> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding con mode: secure
  4356. -578> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding con mode: crc
  4357. -577> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding con mode: crc
  4358. -576> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding con mode: secure
  4359. -575> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding con mode: crc
  4360. -574> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding con mode: secure
  4361. -573> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding con mode: crc
  4362. -572> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d47c40) adding con mode: secure
  4363. -571> 2020-12-12 20:23:42.884 7f2d2dee6c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  4364. -570> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding auth protocol: cephx
  4365. -569> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding auth protocol: cephx
  4366. -568> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding auth protocol: cephx
  4367. -567> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding con mode: secure
  4368. -566> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding con mode: crc
  4369. -565> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding con mode: secure
  4370. -564> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding con mode: crc
  4371. -563> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding con mode: secure
  4372. -562> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding con mode: crc
  4373. -561> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding con mode: crc
  4374. -560> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding con mode: secure
  4375. -559> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding con mode: crc
  4376. -558> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding con mode: secure
  4377. -557> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding con mode: crc
  4378. -556> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48540) adding con mode: secure
  4379. -555> 2020-12-12 20:23:42.884 7f2d2dee6c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  4380. -554> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding auth protocol: cephx
  4381. -553> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding auth protocol: cephx
  4382. -552> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding auth protocol: cephx
  4383. -551> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding con mode: secure
  4384. -550> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding con mode: crc
  4385. -549> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding con mode: secure
  4386. -548> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding con mode: crc
  4387. -547> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding con mode: secure
  4388. -546> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding con mode: crc
  4389. -545> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding con mode: crc
  4390. -544> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding con mode: secure
  4391. -543> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding con mode: crc
  4392. -542> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding con mode: secure
  4393. -541> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding con mode: crc
  4394. -540> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d48e40) adding con mode: secure
  4395. -539> 2020-12-12 20:23:42.884 7f2d2dee6c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  4396. -538> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding auth protocol: cephx
  4397. -537> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding auth protocol: cephx
  4398. -536> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding auth protocol: cephx
  4399. -535> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding con mode: secure
  4400. -534> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding con mode: crc
  4401. -533> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding con mode: secure
  4402. -532> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding con mode: crc
  4403. -531> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding con mode: secure
  4404. -530> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding con mode: crc
  4405. -529> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding con mode: crc
  4406. -528> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding con mode: secure
  4407. -527> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding con mode: crc
  4408. -526> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding con mode: secure
  4409. -525> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding con mode: crc
  4410. -524> 2020-12-12 20:23:42.884 7f2d2dee6c80 5 AuthRegistry(0x559196d49740) adding con mode: secure
  4411. -523> 2020-12-12 20:23:42.884 7f2d2dee6c80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-11/keyring
  4412. -522> 2020-12-12 20:23:42.884 7f2d2dee6c80 0 starting osd.11 osd_data /var/lib/ceph/osd/ceph-11 /var/lib/ceph/osd/ceph-11/journal
  4413. -521> 2020-12-12 20:23:42.888 7f2d2dee6c80 10 monclient: build_initial_monmap
  4414. -520> 2020-12-12 20:23:42.888 7f2d2dee6c80 10 monclient: monmap:
  4415. epoch 0
  4416. fsid 00000000-0000-0000-0000-000000000000
  4417. last_changed 0.000000
  4418. created 0.000000
  4419. min_mon_release 0 (unknown)
  4420. 0: [v2:192.168.8.100:3300/0,v1:192.168.8.100:6789/0] mon.noname-b
  4421. 1: [v2:192.168.8.101:3300/0,v1:192.168.8.101:6789/0] mon.noname-a
  4422. 2: [v2:192.168.8.102:3300/0,v1:192.168.8.102:6789/0] mon.noname-c
  4423.  
  4424. -519> 2020-12-12 20:23:42.896 7f2d2dee6c80 0 load: jerasure load: lrc load: isa
  4425. -518> 2020-12-12 20:23:42.896 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  4426. -517> 2020-12-12 20:23:42.896 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  4427. -516> 2020-12-12 20:23:42.896 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4428. -515> 2020-12-12 20:23:42.896 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  4429. -514> 2020-12-12 20:23:42.896 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) close
  4430. -513> 2020-12-12 20:23:43.176 7f2d2dee6c80 5 asok(0x55919616a000) register_command objecter_requests hook 0x5591960cc940
  4431. -512> 2020-12-12 20:23:43.176 7f2d2dee6c80 2 osd.11 0 init /var/lib/ceph/osd/ceph-11 (looks like hdd)
  4432. -511> 2020-12-12 20:23:43.176 7f2d2dee6c80 2 osd.11 0 journal /var/lib/ceph/osd/ceph-11/journal
  4433. -510> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _mount path /var/lib/ceph/osd/ceph-11
  4434. -509> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  4435. -508> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  4436. -507> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev(0x559196da2000 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4437. -506> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
  4438. -505> 2020-12-12 20:23:43.176 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore bluefs available hook 0x5591960cc950
  4439. -504> 2020-12-12 20:23:43.176 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore bluefs stats hook 0x5591960cc950
  4440. -503> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  4441. -502> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev(0x559196da3880 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  4442. -501> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev(0x559196da3880 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4443. -500> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  4444. -499> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  4445. -498> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev(0x559196da3500 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  4446. -497> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bdev(0x559196da3500 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4447. -496> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  4448. -495> 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option compaction_readahead_size = 2097152
  4449. -494> 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option compression = kNoCompression
  4450. -493> 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option max_background_compactions = 2
  4451. -492> 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option max_write_buffer_number = 4
  4452. -491> 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  4453. -490> 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option recycle_log_file_num = 4
  4454. -489> 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option writable_file_max_buffer_size = 0
  4455. -488> 2020-12-12 20:23:43.176 7f2d2dee6c80 0 set rocksdb option write_buffer_size = 268435456
  4456. -487> 2020-12-12 20:23:43.176 7f2d2dee6c80 1 bluefs mount
  4457. -486> 2020-12-12 20:23:43.180 7f2d2dee6c80 1 bluefs _init_alloc id 1 alloc_size 0x100000 size 0x14c8500000
  4458. -485> 2020-12-12 20:23:43.180 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator dump bluefs-db hook 0x559196f4ab10
  4459. -484> 2020-12-12 20:23:43.180 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator score bluefs-db hook 0x559196f4ab10
  4460. -483> 2020-12-12 20:23:43.180 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator fragmentation bluefs-db hook 0x559196f4ab10
  4461. -482> 2020-12-12 20:23:43.180 7f2d2dee6c80 1 bluefs _init_alloc id 2 alloc_size 0x10000 size 0x3a381400000
  4462. -481> 2020-12-12 20:23:43.180 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator dump bluefs-slow hook 0x559196f4aae0
  4463. -480> 2020-12-12 20:23:43.180 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator score bluefs-slow hook 0x559196f4aae0
  4464. -479> 2020-12-12 20:23:43.180 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator fragmentation bluefs-slow hook 0x559196f4aae0
  4465. -478> 2020-12-12 20:23:43.208 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db set db_paths to db,84797030400 db.slow,3800743857356
  4466. -477> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option compaction_readahead_size = 2097152
  4467. -476> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option compression = kNoCompression
  4468. -475> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option max_background_compactions = 2
  4469. -474> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option max_write_buffer_number = 4
  4470. -473> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  4471. -472> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option recycle_log_file_num = 4
  4472. -471> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option writable_file_max_buffer_size = 0
  4473. -470> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option write_buffer_size = 268435456
  4474. -469> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option compaction_readahead_size = 2097152
  4475. -468> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option compression = kNoCompression
  4476. -467> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option max_background_compactions = 2
  4477. -466> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option max_write_buffer_number = 4
  4478. -465> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  4479. -464> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option recycle_log_file_num = 4
  4480. -463> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option writable_file_max_buffer_size = 0
  4481. -462> 2020-12-12 20:23:43.208 7f2d2dee6c80 0 set rocksdb option write_buffer_size = 268435456
  4482. -461> 2020-12-12 20:23:43.212 7f2d2dee6c80 1 rocksdb: do_open column families: [default]
  4483. -460> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: RocksDB version: 6.1.2
  4484.  
  4485. -459> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  4486. -458> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Compile date Dec 2 2020
  4487. -457> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: DB SUMMARY
  4488.  
  4489. -456> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: CURRENT file: CURRENT
  4490.  
  4491. -455> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: IDENTITY file: IDENTITY
  4492.  
  4493. -454> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: MANIFEST file: MANIFEST-003622 size: 6029 Bytes
  4494.  
  4495. -453> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: SST files in db dir, Total Num: 47, files: 000199.sst 000264.sst 000265.sst 000340.sst 000341.sst 000342.sst 000343.sst 000345.sst 000346.sst
  4496.  
  4497. -452> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
  4498.  
  4499. -451> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Write Ahead Log file in db.wal: 003623.log size: 0 ;
  4500.  
  4501. -450> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.error_if_exists: 0
  4502. -449> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.create_if_missing: 0
  4503. -448> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.paranoid_checks: 1
  4504. -447> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.env: 0x559196e56d40
  4505. -446> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.info_log: 0x559196e57760
  4506. -445> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_file_opening_threads: 16
  4507. -444> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.statistics: (nil)
  4508. -443> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.use_fsync: 0
  4509. -442> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_log_file_size: 0
  4510. -441> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
  4511. -440> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.log_file_time_to_roll: 0
  4512. -439> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.keep_log_file_num: 1000
  4513. -438> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.recycle_log_file_num: 4
  4514. -437> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.allow_fallocate: 1
  4515. -436> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.allow_mmap_reads: 0
  4516. -435> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.allow_mmap_writes: 0
  4517. -434> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.use_direct_reads: 0
  4518. -433> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  4519. -432> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.create_missing_column_families: 0
  4520. -431> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.db_log_dir:
  4521. -430> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.wal_dir: db.wal
  4522. -429> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.table_cache_numshardbits: 6
  4523. -428> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_subcompactions: 1
  4524. -427> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_background_flushes: -1
  4525. -426> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.WAL_ttl_seconds: 0
  4526. -425> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.WAL_size_limit_MB: 0
  4527. -424> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
  4528. -423> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.is_fd_close_on_exec: 1
  4529. -422> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.advise_random_on_open: 1
  4530. -421> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.db_write_buffer_size: 0
  4531. -420> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.write_buffer_manager: 0x559196f4ade0
  4532. -419> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
  4533. -418> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  4534. -417> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  4535. -416> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.use_adaptive_mutex: 0
  4536. -415> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.rate_limiter: (nil)
  4537. -414> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  4538. -413> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.wal_recovery_mode: 0
  4539. -412> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.enable_thread_tracking: 0
  4540. -411> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.enable_pipelined_write: 0
  4541. -410> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  4542. -409> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  4543. -408> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
  4544. -407> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  4545. -406> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.row_cache: None
  4546. -405> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.wal_filter: None
  4547. -404> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
  4548. -403> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.allow_ingest_behind: 0
  4549. -402> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.preserve_deletes: 0
  4550. -401> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.two_write_queues: 0
  4551. -400> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.manual_wal_flush: 0
  4552. -399> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.atomic_flush: 0
  4553. -398> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  4554. -397> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_background_jobs: 2
  4555. -396> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_background_compactions: 2
  4556. -395> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  4557. -394> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.writable_file_max_buffer_size: 0
  4558. -393> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.delayed_write_rate : 16777216
  4559. -392> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_total_wal_size: 0
  4560. -391> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  4561. -390> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.stats_dump_period_sec: 600
  4562. -389> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.stats_persist_period_sec: 600
  4563. -388> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
  4564. -387> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_open_files: -1
  4565. -386> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bytes_per_sync: 0
  4566. -385> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.wal_bytes_per_sync: 0
  4567. -384> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_readahead_size: 2097152
  4568. -383> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Compression algorithms supported:
  4569. -382> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
  4570. -381> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kZSTD supported: 0
  4571. -380> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kXpressCompression supported: 0
  4572. -379> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kLZ4HCCompression supported: 1
  4573. -378> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kLZ4Compression supported: 1
  4574. -377> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kBZip2Compression supported: 0
  4575. -376> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kZlibCompression supported: 1
  4576. -375> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: kSnappyCompression supported: 1
  4577. -374> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Fast CRC32 supported: Supported on x86
  4578. -373> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: [db/db_impl_readonly.cc:22] Opening the db in read only mode
  4579. -372> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-003622
  4580.  
  4581. -371> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  4582.  
  4583. -370> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  4584. -369> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  4585. -368> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_filter: None
  4586. -367> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_filter_factory: None
  4587. -366> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.memtable_factory: SkipListFactory
  4588. -365> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.table_factory: BlockBasedTable
  4589. -364> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5591961c6220)
  4590. cache_index_and_filter_blocks: 1
  4591. cache_index_and_filter_blocks_with_high_priority: 1
  4592. pin_l0_filter_and_index_blocks_in_cache: 0
  4593. pin_top_level_index_and_filter: 1
  4594. index_type: 0
  4595. data_block_index_type: 0
  4596. data_block_hash_table_util_ratio: 0.750000
  4597. hash_index_allow_collision: 1
  4598. checksum: 1
  4599. no_block_cache: 0
  4600. block_cache: 0x559196114a10
  4601. block_cache_name: BinnedLRUCache
  4602. block_cache_options:
  4603. capacity : 429496729
  4604. num_shard_bits : 4
  4605. strict_capacity_limit : 0
  4606. high_pri_pool_ratio: 0.000
  4607. block_cache_compressed: (nil)
  4608. persistent_cache: (nil)
  4609. block_size: 4096
  4610. block_size_deviation: 10
  4611. block_restart_interval: 16
  4612. index_block_restart_interval: 1
  4613. metadata_block_size: 4096
  4614. partition_filters: 0
  4615. use_delta_encoding: 1
  4616. filter_policy: rocksdb.BuiltinBloomFilter
  4617. whole_key_filtering: 1
  4618. verify_compression: 0
  4619. read_amp_bytes_per_bit: 0
  4620. format_version: 2
  4621. enable_index_compression: 1
  4622. block_align: 0
  4623.  
  4624. -363> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.write_buffer_size: 268435456
  4625. -362> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_write_buffer_number: 4
  4626. -361> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression: NoCompression
  4627. -360> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression: Disabled
  4628. -359> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.prefix_extractor: nullptr
  4629. -358> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  4630. -357> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.num_levels: 7
  4631. -356> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  4632. -355> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  4633. -354> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  4634. -353> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  4635. -352> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  4636. -351> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  4637. -350> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  4638. -349> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  4639. -348> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression_opts.window_bits: -14
  4640. -347> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression_opts.level: 32767
  4641. -346> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression_opts.strategy: 0
  4642. -345> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  4643. -344> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  4644. -343> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compression_opts.enabled: false
  4645. -342> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  4646. -341> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  4647. -340> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
  4648. -339> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.target_file_size_base: 67108864
  4649. -338> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.target_file_size_multiplier: 1
  4650. -337> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  4651. -336> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  4652. -335> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  4653. -334> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  4654. -333> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  4655. -332> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  4656. -331> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  4657. -330> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  4658. -329> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  4659. -328> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  4660. -327> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  4661. -326> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
  4662. -325> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.arena_block_size: 33554432
  4663. -324> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  4664. -323> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  4665. -322> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  4666. -321> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.disable_auto_compactions: 0
  4667. -320> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  4668. -319> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  4669. -318> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  4670. -317> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  4671. -316> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  4672. -315> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  4673. -314> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  4674. -313> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  4675. -312> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  4676. -311> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  4677. -310> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.table_properties_collectors:
  4678. -309> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.inplace_update_support: 0
  4679. -308> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.inplace_update_num_locks: 10000
  4680. -307> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  4681. -306> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
  4682. -305> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.memtable_huge_page_size: 0
  4683. -304> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.bloom_locality: 0
  4684. -303> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.max_successive_merges: 0
  4685. -302> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.optimize_filters_for_hits: 0
  4686. -301> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.paranoid_file_checks: 0
  4687. -300> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.force_consistency_checks: 0
  4688. -299> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.report_bg_io_stats: 0
  4689. -298> 2020-12-12 20:23:43.212 7f2d2dee6c80 4 rocksdb: Options.ttl: 0
  4690. -297> 2020-12-12 20:23:43.216 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-003622 succeeded,manifest_file_number is 3622, next_file_number is 3624, last_sequence is 22382894, log_number is 3621,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  4691.  
  4692. -296> 2020-12-12 20:23:43.216 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 3621
  4693.  
  4694. -295> 2020-12-12 20:23:43.216 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023218647, "job": 1, "event": "recovery_started", "log_files": [3623]}
  4695. -294> 2020-12-12 20:23:43.216 7f2d2dee6c80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3623 mode 0
  4696. -293> 2020-12-12 20:23:43.216 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023218669, "job": 1, "event": "recovery_finished"}
  4697. -292> 2020-12-12 20:23:43.216 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  4698. -291> 2020-12-12 20:23:43.220 7f2d2dee6c80 1 get compressor snappy = 0
  4699. -290> 2020-12-12 20:23:43.220 7f2d2dee6c80 1 load compressor snappy
  4700. -289> 2020-12-12 20:23:43.220 7f2d2dee6c80 1 add compressor snappy 0x559196f4bf20
  4701. -288> 2020-12-12 20:23:43.220 7f2d2dee6c80 1 get compressor snappy = 0x559196f4bf20
  4702. -287> 2020-12-12 20:23:43.220 7f2d2dee6c80 1 load: compressor snappy loaded and registered
  4703. -286> 2020-12-12 20:23:43.220 7f2d2dee6c80 1 get compressor snappy = 0x559196f4bf20
  4704. -285> 2020-12-12 20:23:43.220 7f2d2dee6c80 1 freelist init
  4705. -284> 2020-12-12 20:23:43.224 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator dump block hook 0x5591971205d0
  4706. -283> 2020-12-12 20:23:43.224 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator score block hook 0x5591971205d0
  4707. -282> 2020-12-12 20:23:43.224 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator fragmentation block hook 0x5591971205d0
  4708. -281> 2020-12-12 20:23:43.224 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_alloc opening allocation metadata
  4709. -280> 2020-12-12 20:23:43.380 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_alloc loaded 2.3 TiB in 139875 extents available 2.2 TiB
  4710. -279> 2020-12-12 20:23:43.380 7f2d2dee6c80 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work
  4711. -278> 2020-12-12 20:23:43.380 7f2d2dee6c80 4 rocksdb: [db/db_impl.cc:563] Shutdown complete
  4712. -277> 2020-12-12 20:23:43.380 7f2d2dee6c80 1 bluefs umount
  4713. -276> 2020-12-12 20:23:43.380 7f2d2dee6c80 5 asok(0x55919616a000) unregister_command bluestore allocator dump bluefs-db
  4714. -275> 2020-12-12 20:23:43.380 7f2d2dee6c80 5 asok(0x55919616a000) unregister_command bluestore allocator score bluefs-db
  4715. -274> 2020-12-12 20:23:43.380 7f2d2dee6c80 5 asok(0x55919616a000) unregister_command bluestore allocator fragmentation bluefs-db
  4716. -273> 2020-12-12 20:23:43.380 7f2d2dee6c80 5 asok(0x55919616a000) unregister_command bluestore allocator dump bluefs-slow
  4717. -272> 2020-12-12 20:23:43.380 7f2d2dee6c80 5 asok(0x55919616a000) unregister_command bluestore allocator score bluefs-slow
  4718. -271> 2020-12-12 20:23:43.380 7f2d2dee6c80 5 asok(0x55919616a000) unregister_command bluestore allocator fragmentation bluefs-slow
  4719. -270> 2020-12-12 20:23:43.380 7f2d2dee6c80 5 asok(0x55919616a000) unregister_commands bluestore bluefs available
  4720. -269> 2020-12-12 20:23:43.380 7f2d2dee6c80 5 asok(0x55919616a000) unregister_commands bluestore bluefs stats
  4721. -268> 2020-12-12 20:23:43.380 7f2d2dee6c80 1 bdev(0x559196da3880 /var/lib/ceph/osd/ceph-11/block.db) close
  4722. -267> 2020-12-12 20:23:43.468 7f2d2dee6c80 1 bdev(0x559196da3500 /var/lib/ceph/osd/ceph-11/block) close
  4723. -266> 2020-12-12 20:23:43.740 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore bluefs available hook 0x5591960cc950
  4724. -265> 2020-12-12 20:23:43.740 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore bluefs stats hook 0x5591960cc950
  4725. -264> 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block.db type kernel
  4726. -263> 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bdev(0x559196da3500 /var/lib/ceph/osd/ceph-11/block.db) open path /var/lib/ceph/osd/ceph-11/block.db
  4727. -262> 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bdev(0x559196da3500 /var/lib/ceph/osd/ceph-11/block.db) open size 89260032000 (0x14c8500000, 83 GiB) block_size 4096 (4 KiB) non-rotational discard supported
  4728. -261> 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-11/block.db size 83 GiB
  4729. -260> 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bdev create path /var/lib/ceph/osd/ceph-11/block type kernel
  4730. -259> 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bdev(0x559196da3880 /var/lib/ceph/osd/ceph-11/block) open path /var/lib/ceph/osd/ceph-11/block
  4731. -258> 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bdev(0x559196da3880 /var/lib/ceph/osd/ceph-11/block) open size 4000783007744 (0x3a381400000, 3.6 TiB) block_size 4096 (4 KiB) rotational discard not supported
  4732. -257> 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-11/block size 3.6 TiB
  4733. -256> 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option compaction_readahead_size = 2097152
  4734. -255> 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option compression = kNoCompression
  4735. -254> 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option max_background_compactions = 2
  4736. -253> 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option max_write_buffer_number = 4
  4737. -252> 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  4738. -251> 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option recycle_log_file_num = 4
  4739. -250> 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option writable_file_max_buffer_size = 0
  4740. -249> 2020-12-12 20:23:43.740 7f2d2dee6c80 0 set rocksdb option write_buffer_size = 268435456
  4741. -248> 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bluefs mount
  4742. -247> 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bluefs _init_alloc id 1 alloc_size 0x100000 size 0x14c8500000
  4743. -246> 2020-12-12 20:23:43.740 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator dump bluefs-db hook 0x559196f4ac90
  4744. -245> 2020-12-12 20:23:43.740 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator score bluefs-db hook 0x559196f4ac90
  4745. -244> 2020-12-12 20:23:43.740 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator fragmentation bluefs-db hook 0x559196f4ac90
  4746. -243> 2020-12-12 20:23:43.740 7f2d2dee6c80 1 bluefs _init_alloc id 2 alloc_size 0x10000 size 0x3a381400000
  4747. -242> 2020-12-12 20:23:43.740 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator dump bluefs-slow hook 0x559196f4ac60
  4748. -241> 2020-12-12 20:23:43.740 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator score bluefs-slow hook 0x559196f4ac60
  4749. -240> 2020-12-12 20:23:43.740 7f2d2dee6c80 5 asok(0x55919616a000) register_command bluestore allocator fragmentation bluefs-slow hook 0x559196f4ac60
  4750. -239> 2020-12-12 20:23:43.776 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db set db_paths to db,84797030400 db.slow,3800743857356
  4751. -238> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option compaction_readahead_size = 2097152
  4752. -237> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option compression = kNoCompression
  4753. -236> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option max_background_compactions = 2
  4754. -235> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option max_write_buffer_number = 4
  4755. -234> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  4756. -233> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option recycle_log_file_num = 4
  4757. -232> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option writable_file_max_buffer_size = 0
  4758. -231> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option write_buffer_size = 268435456
  4759. -230> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option compaction_readahead_size = 2097152
  4760. -229> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option compression = kNoCompression
  4761. -228> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option max_background_compactions = 2
  4762. -227> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option max_write_buffer_number = 4
  4763. -226> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option min_write_buffer_number_to_merge = 1
  4764. -225> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option recycle_log_file_num = 4
  4765. -224> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option writable_file_max_buffer_size = 0
  4766. -223> 2020-12-12 20:23:43.776 7f2d2dee6c80 0 set rocksdb option write_buffer_size = 268435456
  4767. -222> 2020-12-12 20:23:43.776 7f2d2dee6c80 1 rocksdb: do_open column families: [default]
  4768. -221> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: RocksDB version: 6.1.2
  4769.  
  4770. -220> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
  4771. -219> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Compile date Dec 2 2020
  4772. -218> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: DB SUMMARY
  4773.  
  4774. -217> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: CURRENT file: CURRENT
  4775.  
  4776. -216> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: IDENTITY file: IDENTITY
  4777.  
  4778. -215> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: MANIFEST file: MANIFEST-003622 size: 6029 Bytes
  4779.  
  4780. -214> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: SST files in db dir, Total Num: 47, files: 000199.sst 000264.sst 000265.sst 000340.sst 000341.sst 000342.sst 000343.sst 000345.sst 000346.sst
  4781.  
  4782. -213> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
  4783.  
  4784. -212> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Write Ahead Log file in db.wal: 003623.log size: 0 ;
  4785.  
  4786. -211> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.error_if_exists: 0
  4787. -210> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.create_if_missing: 0
  4788. -209> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.paranoid_checks: 1
  4789. -208> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.env: 0x559196e57140
  4790. -207> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.info_log: 0x559198086f40
  4791. -206> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_file_opening_threads: 16
  4792. -205> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.statistics: (nil)
  4793. -204> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.use_fsync: 0
  4794. -203> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_log_file_size: 0
  4795. -202> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_manifest_file_size: 1073741824
  4796. -201> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.log_file_time_to_roll: 0
  4797. -200> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.keep_log_file_num: 1000
  4798. -199> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.recycle_log_file_num: 4
  4799. -198> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.allow_fallocate: 1
  4800. -197> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.allow_mmap_reads: 0
  4801. -196> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.allow_mmap_writes: 0
  4802. -195> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.use_direct_reads: 0
  4803. -194> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
  4804. -193> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.create_missing_column_families: 0
  4805. -192> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.db_log_dir:
  4806. -191> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.wal_dir: db.wal
  4807. -190> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.table_cache_numshardbits: 6
  4808. -189> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_subcompactions: 1
  4809. -188> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_background_flushes: -1
  4810. -187> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.WAL_ttl_seconds: 0
  4811. -186> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.WAL_size_limit_MB: 0
  4812. -185> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.manifest_preallocation_size: 4194304
  4813. -184> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.is_fd_close_on_exec: 1
  4814. -183> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.advise_random_on_open: 1
  4815. -182> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.db_write_buffer_size: 0
  4816. -181> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.write_buffer_manager: 0x559196f4be60
  4817. -180> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.access_hint_on_compaction_start: 1
  4818. -179> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
  4819. -178> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
  4820. -177> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.use_adaptive_mutex: 0
  4821. -176> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.rate_limiter: (nil)
  4822. -175> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
  4823. -174> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.wal_recovery_mode: 0
  4824. -173> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.enable_thread_tracking: 0
  4825. -172> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.enable_pipelined_write: 0
  4826. -171> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
  4827. -170> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
  4828. -169> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.write_thread_max_yield_usec: 100
  4829. -168> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
  4830. -167> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.row_cache: None
  4831. -166> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.wal_filter: None
  4832. -165> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.avoid_flush_during_recovery: 0
  4833. -164> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.allow_ingest_behind: 0
  4834. -163> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.preserve_deletes: 0
  4835. -162> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.two_write_queues: 0
  4836. -161> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.manual_wal_flush: 0
  4837. -160> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.atomic_flush: 0
  4838. -159> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
  4839. -158> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_background_jobs: 2
  4840. -157> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_background_compactions: 2
  4841. -156> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
  4842. -155> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.writable_file_max_buffer_size: 0
  4843. -154> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.delayed_write_rate : 16777216
  4844. -153> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_total_wal_size: 0
  4845. -152> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
  4846. -151> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.stats_dump_period_sec: 600
  4847. -150> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.stats_persist_period_sec: 600
  4848. -149> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.stats_history_buffer_size: 1048576
  4849. -148> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_open_files: -1
  4850. -147> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bytes_per_sync: 0
  4851. -146> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.wal_bytes_per_sync: 0
  4852. -145> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_readahead_size: 2097152
  4853. -144> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Compression algorithms supported:
  4854. -143> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kZSTDNotFinalCompression supported: 0
  4855. -142> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kZSTD supported: 0
  4856. -141> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kXpressCompression supported: 0
  4857. -140> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kLZ4HCCompression supported: 1
  4858. -139> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kLZ4Compression supported: 1
  4859. -138> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kBZip2Compression supported: 0
  4860. -137> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kZlibCompression supported: 1
  4861. -136> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: kSnappyCompression supported: 1
  4862. -135> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Fast CRC32 supported: Supported on x86
  4863. -134> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-003622
  4864.  
  4865. -133> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
  4866.  
  4867. -132> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
  4868. -131> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
  4869. -130> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_filter: None
  4870. -129> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_filter_factory: None
  4871. -128> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.memtable_factory: SkipListFactory
  4872. -127> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.table_factory: BlockBasedTable
  4873. -126> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5591960cb210)
  4874. cache_index_and_filter_blocks: 1
  4875. cache_index_and_filter_blocks_with_high_priority: 1
  4876. pin_l0_filter_and_index_blocks_in_cache: 0
  4877. pin_top_level_index_and_filter: 1
  4878. index_type: 0
  4879. data_block_index_type: 0
  4880. data_block_hash_table_util_ratio: 0.750000
  4881. hash_index_allow_collision: 1
  4882. checksum: 1
  4883. no_block_cache: 0
  4884. block_cache: 0x559196114910
  4885. block_cache_name: BinnedLRUCache
  4886. block_cache_options:
  4887. capacity : 429496729
  4888. num_shard_bits : 4
  4889. strict_capacity_limit : 0
  4890. high_pri_pool_ratio: 0.000
  4891. block_cache_compressed: (nil)
  4892. persistent_cache: (nil)
  4893. block_size: 4096
  4894. block_size_deviation: 10
  4895. block_restart_interval: 16
  4896. index_block_restart_interval: 1
  4897. metadata_block_size: 4096
  4898. partition_filters: 0
  4899. use_delta_encoding: 1
  4900. filter_policy: rocksdb.BuiltinBloomFilter
  4901. whole_key_filtering: 1
  4902. verify_compression: 0
  4903. read_amp_bytes_per_bit: 0
  4904. format_version: 2
  4905. enable_index_compression: 1
  4906. block_align: 0
  4907.  
  4908. -125> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.write_buffer_size: 268435456
  4909. -124> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_write_buffer_number: 4
  4910. -123> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression: NoCompression
  4911. -122> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression: Disabled
  4912. -121> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.prefix_extractor: nullptr
  4913. -120> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
  4914. -119> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.num_levels: 7
  4915. -118> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
  4916. -117> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
  4917. -116> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
  4918. -115> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
  4919. -114> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
  4920. -113> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
  4921. -112> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
  4922. -111> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
  4923. -110> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression_opts.window_bits: -14
  4924. -109> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression_opts.level: 32767
  4925. -108> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression_opts.strategy: 0
  4926. -107> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
  4927. -106> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
  4928. -105> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compression_opts.enabled: false
  4929. -104> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
  4930. -103> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
  4931. -102> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.level0_stop_writes_trigger: 36
  4932. -101> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.target_file_size_base: 67108864
  4933. -100> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.target_file_size_multiplier: 1
  4934. -99> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
  4935. -98> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
  4936. -97> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
  4937. -96> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
  4938. -95> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
  4939. -94> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
  4940. -93> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
  4941. -92> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
  4942. -91> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
  4943. -90> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
  4944. -89> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
  4945. -88> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_compaction_bytes: 1677721600
  4946. -87> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.arena_block_size: 33554432
  4947. -86> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
  4948. -85> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
  4949. -84> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
  4950. -83> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.disable_auto_compactions: 0
  4951. -82> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
  4952. -81> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
  4953. -80> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
  4954. -79> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
  4955. -78> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
  4956. -77> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
  4957. -76> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
  4958. -75> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
  4959. -74> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
  4960. -73> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
  4961. -72> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.table_properties_collectors:
  4962. -71> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.inplace_update_support: 0
  4963. -70> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.inplace_update_num_locks: 10000
  4964. -69> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
  4965. -68> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.memtable_whole_key_filtering: 0
  4966. -67> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.memtable_huge_page_size: 0
  4967. -66> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.bloom_locality: 0
  4968. -65> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.max_successive_merges: 0
  4969. -64> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.optimize_filters_for_hits: 0
  4970. -63> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.paranoid_file_checks: 0
  4971. -62> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.force_consistency_checks: 0
  4972. -61> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.report_bg_io_stats: 0
  4973. -60> 2020-12-12 20:23:43.776 7f2d2dee6c80 4 rocksdb: Options.ttl: 0
  4974. -59> 2020-12-12 20:23:43.780 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-003622 succeeded,manifest_file_number is 3622, next_file_number is 3624, last_sequence is 22382894, log_number is 3621,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
  4975.  
  4976. -58> 2020-12-12 20:23:43.780 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 3621
  4977.  
  4978. -57> 2020-12-12 20:23:43.780 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023785737, "job": 1, "event": "recovery_started", "log_files": [3623]}
  4979. -56> 2020-12-12 20:23:43.780 7f2d2dee6c80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3623 mode 0
  4980. -55> 2020-12-12 20:23:43.780 7f2d2dee6c80 4 rocksdb: [db/version_set.cc:3036] Creating manifest 3625
  4981.  
  4982. -54> 2020-12-12 20:23:43.784 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023787624, "job": 1, "event": "recovery_finished"}
  4983. -53> 2020-12-12 20:23:43.784 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023787757, "job": 2, "event": "table_file_deletion", "file_number": 3629}
  4984. -52> 2020-12-12 20:23:43.784 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023787775, "job": 2, "event": "table_file_deletion", "file_number": 3628}
  4985. -51> 2020-12-12 20:23:43.784 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023787782, "job": 2, "event": "table_file_deletion", "file_number": 3627}
  4986. -50> 2020-12-12 20:23:43.784 7f2d2dee6c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023787788, "job": 2, "event": "table_file_deletion", "file_number": 3626}
  4987. -49> 2020-12-12 20:23:43.788 7f2d2dee6c80 4 rocksdb: DB pointer 0x559198144000
  4988. -48> 2020-12-12 20:23:43.788 7f2d23408700 4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 3] Compacting 1@1 + 4@2 files to L2, score 1.03
  4989. -47> 2020-12-12 20:23:43.788 7f2d23408700 4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 2 Base level 1, inputs: [449(64MB)], [345(64MB) 346(64MB) 347(64MB) 348(64MB)]
  4990.  
  4991. -46> 2020-12-12 20:23:43.788 7f2d23408700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837023790147, "job": 3, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [449], "files_L2": [345, 346, 347, 348], "score": 1.02872, "input_data_size": 338693918}
  4992. -45> 2020-12-12 20:23:43.788 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _open_db opened rocksdb path db options compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2
  4993. -44> 2020-12-12 20:23:43.788 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _upgrade_super from 2, latest 2
  4994. -43> 2020-12-12 20:23:43.788 7f2d2dee6c80 1 bluestore(/var/lib/ceph/osd/ceph-11) _upgrade_super done
  4995. -42> 2020-12-12 20:23:43.788 7f2d1a3f6700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS -------
  4996. -41> 2020-12-12 20:23:43.788 7f2d1a3f6700 4 rocksdb: [db/db_impl.cc:778]
  4997. ** DB Stats **
  4998. Uptime(secs): 0.0 total, 0.0 interval
  4999. Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
  5000. Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
  5001. Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
  5002. Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
  5003. Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
  5004. Interval stall: 00:00:0.000 H:M:S, 0.0 percent
  5005.  
  5006. ** Compaction Stats [default] **
  5007. Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  5008. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  5009. L0 2/0 3.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  5010. L1 4/1 194.65 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  5011. L2 37/4 2.22 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  5012. Sum 43/5 2.41 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  5013. Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  5014.  
  5015. ** Compaction Stats [default] **
  5016. Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  5017. -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  5018. Uptime(secs): 0.0 total, 0.0 interval
  5019. Flush(GB): cumulative 0.000, interval 0.000
  5020. AddFile(GB): cumulative 0.000, interval 0.000
  5021. AddFile(Total Files): cumulative 0, interval 0
  5022. AddFile(L0 Files): cumulative 0, interval 0
  5023. AddFile(Keys): cumulative 0, interval 0
  5024. Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  5025. Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  5026. Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
  5027.  
  5028. ** File Read Latency Histogram By Level [default] **
  5029.  
  5030. ** Compaction Stats [default] **
  5031. Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  5032. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  5033. L0 2/0 3.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  5034. L1 4/1 194.65 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  5035. L2 37/4 2.22 GB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  5036. Sum 43/5 2.41 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  5037. Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0
  5038.  
  5039. ** Compaction Stats [default] **
  5040. Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
  5041. -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  5042. Uptime(secs): 0.0 total, 0.0 interval
  5043. Flush(GB): cumulative 0.000, interval 0.000
  5044. AddFile(GB): cumulative 0.000, interval 0.000
  5045. AddFile(Total Files): cumulative 0, interval 0
  5046. AddFile(L0 Files): cumulative 0, interval 0
  5047. AddFile(Keys): cumulative 0, interval 0
  5048. Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  5049. Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
  5050. Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
  5051.  
  5052. ** File Read Latency Histogram By Level [default] **
  5053.  
  5054. -40> 2020-12-12 20:23:43.828 7f2d2dee6c80 2 osd.11 0 journal looks like ssd
  5055. -39> 2020-12-12 20:23:43.828 7f2d2dee6c80 2 osd.11 0 boot
  5056. -38> 2020-12-12 20:23:43.828 7f2d20402700 5 prioritycache tune_memory target: 4294967296 mapped: 47620096 unmapped: 1024000 heap: 48644096 old mem: 134217728 new mem: 2815355647
  5057. -37> 2020-12-12 20:23:43.828 7f2d20402700 5 prioritycache tune_memory target: 4294967296 mapped: 48275456 unmapped: 1417216 heap: 49692672 old mem: 2815355647 new mem: 2845077956
  5058. -36> 2020-12-12 20:23:43.828 7f2d20402700 5 bluestore.MempoolThread(0x559196db0b70) _trim_shards cache_size: 2845077956 kv_alloc: 1056964608 kv_used: 3206336 meta_alloc: 1056964608 meta_used: 15896 data_alloc: 671088640 data_used: 0
  5059. -35> 2020-12-12 20:23:43.840 7f2d2dee6c80 0 _get_class not permitted to load sdk
  5060. -34> 2020-12-12 20:23:43.840 7f2d2dee6c80 0 <cls> /build/ceph/ceph-14.2.15/src/cls/hello/cls_hello.cc:296: loading cls_hello
  5061. -33> 2020-12-12 20:23:43.844 7f2d2dee6c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/user/cls_user.cc:429: Loaded user class!
  5062. -32> 2020-12-12 20:23:43.844 7f2d2dee6c80 0 _get_class not permitted to load lua
  5063. -31> 2020-12-12 20:23:43.844 7f2d2dee6c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/refcount/cls_refcount.cc:198: Loaded refcount class!
  5064. -30> 2020-12-12 20:23:43.844 7f2d2dee6c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/timeindex/cls_timeindex.cc:242: Loaded timeindex class!
  5065. -29> 2020-12-12 20:23:43.848 7f2d2dee6c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/rgw/cls_rgw.cc:3905: Loaded rgw class!
  5066. -28> 2020-12-12 20:23:43.848 7f2d2dee6c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/log/cls_log.cc:299: Loaded log class!
  5067. -27> 2020-12-12 20:23:43.848 7f2d2dee6c80 0 _get_class not permitted to load kvs
  5068. -26> 2020-12-12 20:23:43.848 7f2d2dee6c80 0 <cls> /build/ceph/ceph-14.2.15/src/cls/cephfs/cls_cephfs.cc:197: loading cephfs
  5069. -25> 2020-12-12 20:23:43.848 7f2d2dee6c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/cas/cls_cas.cc:237: Loaded cas class!
  5070. -24> 2020-12-12 20:23:43.848 7f2d2dee6c80 1 <cls> /build/ceph/ceph-14.2.15/src/cls/version/cls_version.cc:214: Loaded version class!
  5071. -23> 2020-12-12 20:23:43.848 7f2d2dee6c80 0 osd.11 120674 crush map has features 432629308056666112, adjusting msgr requires for clients
  5072. -22> 2020-12-12 20:23:43.848 7f2d2dee6c80 0 osd.11 120674 crush map has features 432629308056666112 was 8705, adjusting msgr requires for mons
  5073. -21> 2020-12-12 20:23:43.848 7f2d2dee6c80 0 osd.11 120674 crush map has features 3314933069573799936, adjusting msgr requires for osds
  5074. -20> 2020-12-12 20:23:44.212 7f2d23408700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3629: 42754 keys, 67717992 bytes
  5075. -19> 2020-12-12 20:23:44.212 7f2d23408700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837024216689, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3629, "file_size": 67717992, "table_properties": {"data_size": 67112720, "index_size": 497464, "filter_size": 106949, "raw_key_size": 2795150, "raw_average_key_size": 65, "raw_value_size": 64371790, "raw_average_value_size": 1505, "num_data_blocks": 14079, "num_entries": 42754, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  5076. -18> 2020-12-12 20:23:44.604 7f2d23408700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3630: 43658 keys, 67732235 bytes
  5077. -17> 2020-12-12 20:23:44.604 7f2d23408700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837024608149, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3630, "file_size": 67732235, "table_properties": {"data_size": 67111811, "index_size": 510312, "filter_size": 109253, "raw_key_size": 3756526, "raw_average_key_size": 86, "raw_value_size": 63462002, "raw_average_value_size": 1453, "num_data_blocks": 14230, "num_entries": 43658, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  5078. -16> 2020-12-12 20:23:44.832 7f2d20402700 5 prioritycache tune_memory target: 4294967296 mapped: 129081344 unmapped: 5545984 heap: 134627328 old mem: 2845077956 new mem: 2845405678
  5079. -15> 2020-12-12 20:23:45.004 7f2d23408700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3631: 43657 keys, 67729297 bytes
  5080. -14> 2020-12-12 20:23:45.004 7f2d23408700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837025008006, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3631, "file_size": 67729297, "table_properties": {"data_size": 67113092, "index_size": 506093, "filter_size": 109253, "raw_key_size": 3372528, "raw_average_key_size": 77, "raw_value_size": 63853503, "raw_average_value_size": 1462, "num_data_blocks": 14172, "num_entries": 43657, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  5081. -13> 2020-12-12 20:23:45.360 7f2d23408700 4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 3] Generated table #3632: 42522 keys, 67713983 bytes
  5082. -12> 2020-12-12 20:23:45.360 7f2d23408700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1607837025362337, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 3632, "file_size": 67713983, "table_properties": {"data_size": 67112021, "index_size": 494666, "filter_size": 106437, "raw_key_size": 2680741, "raw_average_key_size": 63, "raw_value_size": 64464845, "raw_average_value_size": 1516, "num_data_blocks": 14067, "num_entries": 42522, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
  5083. -11> 2020-12-12 20:23:45.652 7f2d23408700 3 rocksdb: [db/db_impl_compaction_flush.cc:2660] Compaction error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704
  5084. -10> 2020-12-12 20:23:45.652 7f2d23408700 4 rocksdb: (Original Log Time 2020/12/12-20:23:45.656289) [db/compaction_job.cc:768] [default] compacted to: files[2 4 37 0 0 0 0] max score 0.79, MB/sec: 181.5 rd, 145.2 wr, level 2, files in(1, 4) out(5) MB in(64.7, 258.3) out(258.3), read-write-amplify(9.0) write-amplify(4.0) Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704, records in: 243696, records dropped: 28515 output_compression: NoCompression
  5085.  
  5086. -9> 2020-12-12 20:23:45.652 7f2d23408700 4 rocksdb: (Original Log Time 2020/12/12-20:23:45.656341) EVENT_LOG_v1 {"time_micros": 1607837025656320, "job": 3, "event": "compaction_finished", "compaction_time_micros": 1866083, "compaction_time_cpu_micros": 453800, "output_level": 2, "num_output_files": 5, "total_output_size": 318240797, "num_input_records": 231169, "num_output_records": 202654, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [2, 4, 37, 0, 0, 0, 0]}
  5087. -8> 2020-12-12 20:23:45.652 7f2d23408700 2 rocksdb: [db/db_impl_compaction_flush.cc:2212] Waiting after background compaction error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704, Accumulated background error counts: 1
  5088. -7> 2020-12-12 20:23:45.668 7f2d2dee6c80 0 osd.11 120674 load_pgs
  5089. -6> 2020-12-12 20:23:45.672 7f2d2dee6c80 5 osd.11 pg_epoch: 120674 pg[19.fs2(unlocked)] enter Initial
  5090. -5> 2020-12-12 20:23:45.756 7f2d2dee6c80 5 osd.11 pg_epoch: 120674 pg[19.fs2( v 120655'13314733 (120632'13311706,120655'13314733] lb 19:f6f3c78a:::rbd_data.16.9bfacae1273d4e.000000000003951a:head (bitwise) local-lis/les=120084/120085 n=45780 ec=1670/1670 lis/c 120666/119858 les/c/f 120667/119859/0 120674/120674/120674) [2147483647,0,11,7,1,5]/[2147483647,0,8,2147483647,1,5]p0(1) r=-1 lpr=0 pi=[119858,120674)/5 crt=120655'13314733 lcod 0'0 unknown mbc={} ps=[2cd~1,2cf~1,2d1~2,2d4~1,2d6~1,2d8~1,2da~1,2dd~1]] exit Initial 0.082152 0 0.000000
  5091. -4> 2020-12-12 20:23:45.756 7f2d2dee6c80 5 osd.11 pg_epoch: 120674 pg[19.fs2( v 120655'13314733 (120632'13311706,120655'13314733] lb 19:f6f3c78a:::rbd_data.16.9bfacae1273d4e.000000000003951a:head (bitwise) local-lis/les=120084/120085 n=45780 ec=1670/1670 lis/c 120666/119858 les/c/f 120667/119859/0 120674/120674/120674) [2147483647,0,11,7,1,5]/[2147483647,0,8,2147483647,1,5]p0(1) r=-1 lpr=0 pi=[119858,120674)/5 crt=120655'13314733 lcod 0'0 unknown mbc={} ps=[2cd~1,2cf~1,2d1~2,2d4~1,2d6~1,2d8~1,2da~1,2dd~1]] enter Reset
  5092. -3> 2020-12-12 20:23:45.756 7f2d21404700 -1 rocksdb: submit_common error: Corruption: block checksum mismatch: expected 3113305400, got 1242690251 in db/000348.sst offset 47935290 size 4704 code = 2 Rocksdb transaction:
  5093. Put( Prefix = P key = 0x000000000000146e'.can_rollback_to' Value size = 12)
  5094. Put( Prefix = P key = 0x000000000000146e'.rollback_info_trimmed_to' Value size = 12)
  5095. Put( Prefix = O key = 0x828000000000000013f000000021213dfffffffffffffffeffffffffffffffff'o' Value size = 29)
  5096. Put( Prefix = S key = 'nid_max' Value size = 8)
  5097. Put( Prefix = S key = 'blobid_max' Value size = 8)
  5098. -2> 2020-12-12 20:23:45.756 7f2d2dee6c80 5 osd.11 pg_epoch: 120674 pg[19.cs1(unlocked)] enter Initial
  5099. -1> 2020-12-12 20:23:45.756 7f2d21404700 -1 /build/ceph/ceph-14.2.15/src/os/bluestore/BlueStore.cc: In function 'void BlueStore::_kv_sync_thread()' thread 7f2d21404700 time 2020-12-12 20:23:45.759106
  5100. /build/ceph/ceph-14.2.15/src/os/bluestore/BlueStore.cc: 11380: FAILED ceph_assert(r == 0)
  5101.  
  5102. ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable)
  5103. 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x55918be53c1e]
  5104. 2: (()+0x513df6) [0x55918be53df6]
  5105. 3: (BlueStore::_kv_sync_thread()+0x1826) [0x55918c3ec766]
  5106. 4: (BlueStore::KVSyncThread::entry()+0xd) [0x55918c4129bd]
  5107. 5: (()+0x7fa3) [0x7f2d2e92afa3]
  5108. 6: (clone()+0x3f) [0x7f2d2e4da4cf]
  5109.  
  5110. 0> 2020-12-12 20:23:45.760 7f2d21404700 -1 *** Caught signal (Aborted) **
  5111. in thread 7f2d21404700 thread_name:bstore_kv_sync
  5112.  
  5113. ceph version 14.2.15 (e3076ef75049c0eb73e10aa7a50a0b3a60dbaeea) nautilus (stable)
  5114. 1: (()+0x12730) [0x7f2d2e935730]
  5115. 2: (gsignal()+0x10b) [0x7f2d2e4187bb]
  5116. 3: (abort()+0x121) [0x7f2d2e403535]
  5117. 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x55918be53c6f]
  5118. 5: (()+0x513df6) [0x55918be53df6]
  5119. 6: (BlueStore::_kv_sync_thread()+0x1826) [0x55918c3ec766]
  5120. 7: (BlueStore::KVSyncThread::entry()+0xd) [0x55918c4129bd]
  5121. 8: (()+0x7fa3) [0x7f2d2e92afa3]
  5122. 9: (clone()+0x3f) [0x7f2d2e4da4cf]
  5123. NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
  5124.  
  5125. --- logging levels ---
  5126. 0/ 5 none
  5127. 0/ 1 lockdep
  5128. 0/ 1 context
  5129. 1/ 1 crush
  5130. 1/ 5 mds
  5131. 1/ 5 mds_balancer
  5132. 1/ 5 mds_locker
  5133. 1/ 5 mds_log
  5134. 1/ 5 mds_log_expire
  5135. 1/ 5 mds_migrator
  5136. 0/ 1 buffer
  5137. 0/ 1 timer
  5138. 0/ 1 filer
  5139. 0/ 1 striper
  5140. 0/ 1 objecter
  5141. 0/ 5 rados
  5142. 0/ 5 rbd
  5143. 0/ 5 rbd_mirror
  5144. 0/ 5 rbd_replay
  5145. 0/ 5 journaler
  5146. 0/ 5 objectcacher
  5147. 0/ 5 client
  5148. 1/ 5 osd
  5149. 0/ 5 optracker
  5150. 0/ 5 objclass
  5151. 1/ 3 filestore
  5152. 1/ 3 journal
  5153. 0/ 0 ms
  5154. 1/ 5 mon
  5155. 0/10 monc
  5156. 1/ 5 paxos
  5157. 0/ 5 tp
  5158. 1/ 5 auth
  5159. 1/ 5 crypto
  5160. 1/ 1 finisher
  5161. 1/ 1 reserver
  5162. 1/ 5 heartbeatmap
  5163. 1/ 5 perfcounter
  5164. 1/ 5 rgw
  5165. 1/ 5 rgw_sync
  5166. 1/10 civetweb
  5167. 1/ 5 javaclient
  5168. 1/ 5 asok
  5169. 1/ 1 throttle
  5170. 0/ 0 refs
  5171. 1/ 5 xio
  5172. 1/ 5 compressor
  5173. 1/ 5 bluestore
  5174. 1/ 5 bluefs
  5175. 1/ 3 bdev
  5176. 1/ 5 kstore
  5177. 4/ 5 rocksdb
  5178. 4/ 5 leveldb
  5179. 4/ 5 memdb
  5180. 1/ 5 kinetic
  5181. 1/ 5 fuse
  5182. 1/ 5 mgr
  5183. 1/ 5 mgrc
  5184. 1/ 5 dpdk
  5185. 1/ 5 eventtrace
  5186. 1/ 5 prioritycache
  5187. -2/-2 (syslog threshold)
  5188. -1/-1 (stderr threshold)
  5189. max_recent 10000
  5190. max_new 1000
  5191. log_file /var/log/ceph/ceph-osd.11.log
  5192. --- end dump of recent events ---
  5193.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement