Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2019-11-07 10:50:20.359 7f1196326f80 0 set uid:gid to 64045:64045 (ceph:ceph)
- 2019-11-07 10:50:20.359 7f1196326f80 0 ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable), process ceph-osd, pid 159515
- 2019-11-07 10:50:20.359 7f1196326f80 0 pidfile_write: ignore empty --pid-file
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
- 2019-11-07 10:50:20.399 7f1196326f80 0 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block.db type kernel
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block.db) open path /var/lib/ceph/osd/ceph-22/block.db
- 2019-11-07 10:50:20.399 7f1196326f80 0 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.db failed: (22) Invalid argument
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block.db) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
- 2019-11-07 10:50:20.399 7f1196326f80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-22/block.db size 1 GiB
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
- 2019-11-07 10:50:20.399 7f1196326f80 0 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
- 2019-11-07 10:50:20.399 7f1196326f80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-22/block size 5.5 TiB
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block.wal type kernel
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.wal) open path /var/lib/ceph/osd/ceph-22/block.wal
- 2019-11-07 10:50:20.399 7f1196326f80 0 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.wal failed: (22) Invalid argument
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.wal) open size 603979776 (0x24000000, 576 MiB) block_size 4096 (4 KiB) non-rotational discard supported
- 2019-11-07 10:50:20.399 7f1196326f80 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-22/block.wal size 576 MiB
- 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.wal) close
- 2019-11-07 10:50:20.679 7f1196326f80 1 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block.db) close
- 2019-11-07 10:50:20.935 7f1196326f80 1 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block) close
- 2019-11-07 10:50:21.179 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) close
- 2019-11-07 10:50:21.439 7f1196326f80 0 starting osd.22 osd_data /var/lib/ceph/osd/ceph-22 /var/lib/ceph/osd/ceph-22/journal
- 2019-11-07 10:50:21.475 7f1196326f80 0 load: jerasure load: lrc load: isa
- 2019-11-07 10:50:21.475 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
- 2019-11-07 10:50:21.475 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
- 2019-11-07 10:50:21.475 7f1196326f80 0 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
- 2019-11-07 10:50:21.475 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
- 2019-11-07 10:50:21.479 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) close
- 2019-11-07 10:50:21.759 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
- 2019-11-07 10:50:21.759 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
- 2019-11-07 10:50:21.759 7f1196326f80 0 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
- 2019-11-07 10:50:21.759 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
- 2019-11-07 10:50:21.763 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block.db type kernel
- 2019-11-07 10:50:21.763 7f1196326f80 1 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.db) open path /var/lib/ceph/osd/ceph-22/block.db
- 2019-11-07 10:50:21.763 7f1196326f80 0 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.db failed: (22) Invalid argument
- 2019-11-07 10:50:21.763 7f1196326f80 1 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.db) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
- 2019-11-07 10:50:21.763 7f1196326f80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-22/block.db size 1 GiB
- 2019-11-07 10:50:21.763 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
- 2019-11-07 10:50:21.763 7f1196326f80 1 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
- 2019-11-07 10:50:21.763 7f1196326f80 0 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
- 2019-11-07 10:50:21.763 7f1196326f80 1 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
- 2019-11-07 10:50:21.763 7f1196326f80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-22/block size 5.5 TiB
- 2019-11-07 10:50:21.763 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block.wal type kernel
- 2019-11-07 10:50:21.763 7f1196326f80 1 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block.wal) open path /var/lib/ceph/osd/ceph-22/block.wal
- 2019-11-07 10:50:21.763 7f1196326f80 0 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.wal failed: (22) Invalid argument
- 2019-11-07 10:50:21.763 7f1196326f80 1 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block.wal) open size 603979776 (0x24000000, 576 MiB) block_size 4096 (4 KiB) non-rotational discard supported
- 2019-11-07 10:50:21.763 7f1196326f80 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-22/block.wal size 576 MiB
- 2019-11-07 10:50:21.763 7f1196326f80 1 bluefs mount
- 2019-11-07 10:50:21.787 7f1196326f80 0 set rocksdb option compaction_readahead_size = 2097152
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option compression = kNoCompression
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option max_background_compactions = 2
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option max_write_buffer_number = 4
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option min_write_buffer_number_to_merge = 1
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option recycle_log_file_num = 4
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option writable_file_max_buffer_size = 0
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option write_buffer_size = 268435456
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option compaction_readahead_size = 2097152
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option compression = kNoCompression
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option max_background_compactions = 2
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option max_write_buffer_number = 4
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option min_write_buffer_number_to_merge = 1
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option recycle_log_file_num = 4
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option writable_file_max_buffer_size = 0
- 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option write_buffer_size = 268435456
- 2019-11-07 10:50:21.791 7f1196326f80 1 rocksdb: do_open column families: [default]
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: RocksDB version: 6.1.2
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Compile date Sep 13 2019
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: DB SUMMARY
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: CURRENT file: CURRENT
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: IDENTITY file: IDENTITY
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: MANIFEST file: MANIFEST-034878 size: 269419 Bytes
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: SST files in db dir, Total Num: 7, files: 036855.sst 036856.sst 036858.sst 036859.sst 036886.sst 036888.sst 036890.sst
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: SST files in db.slow dir, Total Num: 182, files: 033490.sst 033491.sst 033632.sst 034662.sst 034717.sst 034718.sst 034719.sst 034769.sst 034770.sst
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Write Ahead Log file in db.wal: 036887.log size: 253533899 ; 036889.log size: 255973165 ;
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.error_if_exists: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.create_if_missing: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.paranoid_checks: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.env: 0xd416120
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.info_log: 0xd418640
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_file_opening_threads: 16
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.statistics: (nil)
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.use_fsync: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_log_file_size: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_manifest_file_size: 1073741824
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.log_file_time_to_roll: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.keep_log_file_num: 1000
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.recycle_log_file_num: 4
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.allow_fallocate: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.allow_mmap_reads: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.allow_mmap_writes: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.use_direct_reads: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.create_missing_column_families: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.db_log_dir:
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.wal_dir: db.wal
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.table_cache_numshardbits: 6
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_subcompactions: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_background_flushes: -1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.advise_random_on_open: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.db_write_buffer_size: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.write_buffer_manager: 0xd144f00
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.use_adaptive_mutex: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.rate_limiter: (nil)
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.wal_recovery_mode: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.enable_thread_tracking: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.enable_pipelined_write: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.row_cache: None
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.wal_filter: None
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.allow_ingest_behind: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.preserve_deletes: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.two_write_queues: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.manual_wal_flush: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.atomic_flush: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_background_jobs: 2
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_background_compactions: 2
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.writable_file_max_buffer_size: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.delayed_write_rate : 16777216
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_total_wal_size: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.stats_dump_period_sec: 600
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.stats_persist_period_sec: 600
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.stats_history_buffer_size: 1048576
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_open_files: -1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bytes_per_sync: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_readahead_size: 2097152
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Compression algorithms supported:
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kZSTDNotFinalCompression supported: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kZSTD supported: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kXpressCompression supported: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kLZ4HCCompression supported: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kLZ4Compression supported: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kBZip2Compression supported: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kZlibCompression supported: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kSnappyCompression supported: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Fast CRC32 supported: Supported on x86
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: [db/db_impl_readonly.cc:22] Opening the db in read only mode
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-034878
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_filter: None
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_filter_factory: None
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.table_factory: BlockBasedTable
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0xc460100)
- cache_index_and_filter_blocks: 1
- cache_index_and_filter_blocks_with_high_priority: 1
- pin_l0_filter_and_index_blocks_in_cache: 1
- pin_top_level_index_and_filter: 1
- index_type: 0
- data_block_index_type: 0
- data_block_hash_table_util_ratio: 0.750000
- hash_index_allow_collision: 1
- checksum: 1
- no_block_cache: 0
- block_cache: 0xc4829d0
- block_cache_name: BinnedLRUCache
- block_cache_options:
- capacity : 429496729
- num_shard_bits : 4
- strict_capacity_limit : 0
- high_pri_pool_ratio: 0.000
- block_cache_compressed: (nil)
- persistent_cache: (nil)
- block_size: 4096
- block_size_deviation: 10
- block_restart_interval: 16
- index_block_restart_interval: 1
- metadata_block_size: 4096
- partition_filters: 0
- use_delta_encoding: 1
- filter_policy: rocksdb.BuiltinBloomFilter
- whole_key_filtering: 1
- verify_compression: 0
- read_amp_bytes_per_bit: 0
- format_version: 2
- enable_index_compression: 1
- block_align: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.write_buffer_size: 268435456
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_write_buffer_number: 4
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression: NoCompression
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression: Disabled
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.prefix_extractor: nullptr
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.num_levels: 7
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression_opts.window_bits: -14
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression_opts.level: 32767
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression_opts.strategy: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression_opts.enabled: false
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.target_file_size_base: 67108864
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.target_file_size_multiplier: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.arena_block_size: 33554432
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.disable_auto_compactions: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.table_properties_collectors:
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.inplace_update_support: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.memtable_whole_key_filtering: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.memtable_huge_page_size: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bloom_locality: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_successive_merges: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.paranoid_file_checks: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.force_consistency_checks: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.report_bg_io_stats: 0
- 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.ttl: 0
- 2019-11-07 10:50:21.799 7f1180b0b700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 177636318 in db/036858.sst offset 18446744073709551615 size 18446744073709551615
- 2019-11-07 10:50:21.799 7f1182b0f700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 2028823508 in db/036890.sst offset 18446744073709551615 size 18446744073709551615
- 2019-11-07 10:50:21.799 7f118230e700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 994402680 in db/036888.sst offset 18446744073709551615 size 18446744073709551615
- 2019-11-07 10:50:21.799 7f1181b0d700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 581611736 in db/036886.sst offset 18446744073709551615 size 18446744073709551615
- 2019-11-07 10:50:22.319 7f118230e700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 184561374 in db.slow/036824.sst offset 18446744073709551615 size 18446744073709551615
- 2019-11-07 10:50:22.395 7f1196326f80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-034878 succeeded,manifest_file_number is 34878, next_file_number is 36892, last_sequence is 1244403827, log_number is 36889,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
- 2019-11-07 10:50:22.395 7f1196326f80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 36889
- 2019-11-07 10:50:22.395 7f1196326f80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1573116622399672, "job": 1, "event": "recovery_started", "log_files": [36887, 36889]}
- 2019-11-07 10:50:22.395 7f1196326f80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #36887 mode 0
- 2019-11-07 10:50:23.231 7f1196326f80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #36889 mode 0
- 2019-11-07 10:50:25.095 7f1196326f80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1573116625098605, "job": 1, "event": "recovery_finished"}
- 2019-11-07 10:50:25.299 7f1196326f80 -1 /build/ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: In function 'void AllocatorLevel02<T>::_mark_allocated(uint64_t, uint64_t) [with L1 = AllocatorLevel01Loose; uint64_t = long unsigned int]' thread 7f1196326f80 time 2019-11-07 10:50:25.298070
- /build/ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(available >= allocated)
- ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable)
- 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x85c3c8]
- 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x85c5a3]
- 3: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0xeb665c]
- 4: (BlueStore::_open_alloc()+0x445) [0xd55345]
- 5: (BlueStore::_open_db_and_around(bool)+0x146) [0xd70396]
- 6: (BlueStore::_mount(bool, bool)+0x68a) [0xdbc55a]
- 7: (OSD::init()+0x3b7) [0x909087]
- 8: (main()+0x40d8) [0x863d38]
- 9: (__libc_start_main()+0xf0) [0x7f11930c8830]
- 10: (_start()+0x29) [0x896cb9]
- 2019-11-07 10:50:25.303 7f1196326f80 -1 *** Caught signal (Aborted) **
- in thread 7f1196326f80 thread_name:ceph-osd
- ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable)
- 1: (()+0x11390) [0x7f1193bb2390]
- 2: (gsignal()+0x38) [0x7f11930dd428]
- 3: (abort()+0x16a) [0x7f11930df02a]
- 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x85c419]
- 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x85c5a3]
- 6: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0xeb665c]
- 7: (BlueStore::_open_alloc()+0x445) [0xd55345]
- 8: (BlueStore::_open_db_and_around(bool)+0x146) [0xd70396]
- 9: (BlueStore::_mount(bool, bool)+0x68a) [0xdbc55a]
- 10: (OSD::init()+0x3b7) [0x909087]
- 11: (main()+0x40d8) [0x863d38]
- 12: (__libc_start_main()+0xf0) [0x7f11930c8830]
- 13: (_start()+0x29) [0x896cb9]
- NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- --- begin dump of recent events ---
- -509> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command assert hook 0xc462520
- -508> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command abort hook 0xc462520
- -507> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command perfcounters_dump hook 0xc462520
- -506> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command 1 hook 0xc462520
- -505> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command perf dump hook 0xc462520
- -504> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command perfcounters_schema hook 0xc462520
- -503> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command perf histogram dump hook 0xc462520
- -502> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command 2 hook 0xc462520
- -501> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command perf schema hook 0xc462520
- -500> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command perf histogram schema hook 0xc462520
- -499> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command perf reset hook 0xc462520
- -498> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command config show hook 0xc462520
- -497> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command config help hook 0xc462520
- -496> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command config set hook 0xc462520
- -495> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command config unset hook 0xc462520
- -494> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command config get hook 0xc462520
- -493> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command config diff hook 0xc462520
- -492> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command config diff get hook 0xc462520
- -491> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command log flush hook 0xc462520
- -490> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command log dump hook 0xc462520
- -489> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command log reopen hook 0xc462520
- -488> 2019-11-07 10:50:20.327 7f1196326f80 5 asok(0xc52e000) register_command dump_mempools hook 0xd12e068
- -487> 2019-11-07 10:50:20.335 7f1196326f80 10 monclient: get_monmap_and_config
- -486> 2019-11-07 10:50:20.347 7f1196326f80 10 monclient: build_initial_monmap
- -485> 2019-11-07 10:50:20.347 7f1196326f80 10 monclient: monmap:
- epoch 0
- fsid ed7b2c16-b053-45e2-a1fe-bf3474f90508
- last_changed 2019-11-07 10:50:20.353361
- created 2019-11-07 10:50:20.353361
- min_mon_release 0 (unknown)
- 0: v1:192.168.6.80:6789/0 mon.noname-a-legacy
- 1: v1:192.168.6.81:6789/0 mon.noname-b-legacy
- 2: v1:192.168.6.82:6789/0 mon.noname-c-legacy
- 3: v2:192.168.6.80:3300/0 mon.noname-a
- 4: v2:192.168.6.81:3300/0 mon.noname-b
- 5: v2:192.168.6.82:3300/0 mon.noname-c
- -484> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding auth protocol: cephx
- -483> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding auth protocol: cephx
- -482> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding auth protocol: cephx
- -481> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding auth protocol: none
- -480> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: secure
- -479> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: crc
- -478> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: secure
- -477> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: crc
- -476> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: secure
- -475> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: crc
- -474> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: crc
- -473> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: secure
- -472> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: crc
- -471> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: secure
- -470> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: crc
- -469> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: secure
- -468> 2019-11-07 10:50:20.351 7f1196326f80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
- -467> 2019-11-07 10:50:20.351 7f1196326f80 10 monclient: init
- -466> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding auth protocol: cephx
- -465> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding auth protocol: cephx
- -464> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding auth protocol: cephx
- -463> 2019-11-07 10:50:20.351 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding auth protocol: none
- -462> 2019-11-07 10:50:20.355 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: secure
- -461> 2019-11-07 10:50:20.355 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: crc
- -460> 2019-11-07 10:50:20.355 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: secure
- -459> 2019-11-07 10:50:20.355 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: crc
- -458> 2019-11-07 10:50:20.355 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: secure
- -457> 2019-11-07 10:50:20.355 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: crc
- -456> 2019-11-07 10:50:20.355 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: crc
- -455> 2019-11-07 10:50:20.355 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: secure
- -454> 2019-11-07 10:50:20.355 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: crc
- -453> 2019-11-07 10:50:20.355 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: secure
- -452> 2019-11-07 10:50:20.355 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: crc
- -451> 2019-11-07 10:50:20.355 7f1196326f80 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: secure
- -450> 2019-11-07 10:50:20.355 7f1196326f80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
- -449> 2019-11-07 10:50:20.355 7f1196326f80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
- -448> 2019-11-07 10:50:20.355 7f1196326f80 10 monclient: _reopen_session rank -1
- -447> 2019-11-07 10:50:20.355 7f1196326f80 10 monclient(hunting): picked mon.noname-a-legacy con 0xc50a400 addr v1:192.168.6.80:6789/0
- -446> 2019-11-07 10:50:20.355 7f1196326f80 10 monclient(hunting): picked mon.noname-b con 0xc509b00 addr v2:192.168.6.81:3300/0
- -445> 2019-11-07 10:50:20.355 7f1196326f80 10 monclient(hunting): picked mon.noname-c-legacy con 0xc509680 addr v1:192.168.6.82:6789/0
- -444> 2019-11-07 10:50:20.355 7f1196326f80 10 monclient(hunting): start opening mon connection
- -443> 2019-11-07 10:50:20.355 7f1196326f80 10 monclient(hunting): _renew_subs
- -442> 2019-11-07 10:50:20.355 7f1196326f80 10 monclient(hunting): authenticate will time out at 2019-11-07 10:55:20.357869
- -441> 2019-11-07 10:50:20.355 7f11904d9700 10 monclient(hunting): get_auth_request con 0xc509b00 auth_method 0
- -440> 2019-11-07 10:50:20.355 7f11904d9700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1,2]
- -439> 2019-11-07 10:50:20.355 7f11904d9700 10 monclient(hunting): _init_auth method 2
- -438> 2019-11-07 10:50:20.355 7f11904d9700 10 monclient(hunting): handle_auth_reply_more payload 9
- -437> 2019-11-07 10:50:20.355 7f11904d9700 10 monclient(hunting): handle_auth_reply_more payload_len 9
- -436> 2019-11-07 10:50:20.355 7f11904d9700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
- -435> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient(hunting): _init_auth method 2
- -434> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient(hunting): my global_id is 22067960
- -433> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient(hunting): _init_auth method 2
- -432> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient(hunting): my global_id is 22119054
- -431> 2019-11-07 10:50:20.355 7f11904d9700 10 monclient(hunting): handle_auth_done global_id 22079098 payload 386
- -430> 2019-11-07 10:50:20.355 7f11904d9700 10 monclient: _finish_hunting 0
- -429> 2019-11-07 10:50:20.355 7f11904d9700 1 monclient: found mon.noname-b
- -428> 2019-11-07 10:50:20.355 7f11904d9700 10 monclient: _send_mon_message to mon.noname-b at v2:192.168.6.81:3300/0
- -427> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient: handle_monmap mon_map magic: 0 v1
- -426> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient: got monmap 12 from mon.noname-b (according to old e12)
- -425> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient: dump:
- epoch 12
- fsid ed7b2c16-b053-45e2-a1fe-bf3474f90508
- last_changed 2019-07-22 11:59:41.402816
- created 2016-11-26 14:08:37.372404
- min_mon_release 14 (nautilus)
- 0: [v2:192.168.6.80:3300/0,v1:192.168.6.80:6789/0] mon.ceph-mon1
- 1: [v2:192.168.6.81:3300/0,v1:192.168.6.81:6789/0] mon.ceph-mon2
- 2: [v2:192.168.6.82:3300/0,v1:192.168.6.82:6789/0] mon.ceph-mon3
- -424> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient: _finish_auth 0
- -423> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2019-11-07 10:49:50.359523)
- -422> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient: _send_mon_message to mon.ceph-mon2 at v2:192.168.6.81:3300/0
- -421> 2019-11-07 10:50:20.355 7f1196326f80 5 monclient: authenticate success, global_id 22079098
- -420> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient: handle_config config(35 keys) v1
- -419> 2019-11-07 10:50:20.355 7f1196326f80 10 monclient: get_monmap_and_config success
- -418> 2019-11-07 10:50:20.355 7f1196326f80 10 monclient: shutdown
- -417> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient: handle_monmap mon_map magic: 0 v1
- -416> 2019-11-07 10:50:20.355 7f118e4d5700 4 set_mon_vals no callback set
- -415> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient: got monmap 12 from mon.ceph-mon2 (according to old e12)
- -414> 2019-11-07 10:50:20.355 7f118e4d5700 10 set_mon_vals auth_client_required = cephx
- -413> 2019-11-07 10:50:20.355 7f118e4d5700 10 set_mon_vals auth_cluster_required = cephx
- -412> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient: dump:
- epoch 12
- fsid ed7b2c16-b053-45e2-a1fe-bf3474f90508
- last_changed 2019-07-22 11:59:41.402816
- created 2016-11-26 14:08:37.372404
- min_mon_release 14 (nautilus)
- 0: [v2:192.168.6.80:3300/0,v1:192.168.6.80:6789/0] mon.ceph-mon1
- 1: [v2:192.168.6.81:3300/0,v1:192.168.6.81:6789/0] mon.ceph-mon2
- 2: [v2:192.168.6.82:3300/0,v1:192.168.6.82:6789/0] mon.ceph-mon3
- -411> 2019-11-07 10:50:20.355 7f118e4d5700 10 set_mon_vals auth_service_required = cephx
- -410> 2019-11-07 10:50:20.355 7f118e4d5700 10 set_mon_vals bluestore_block_db_path = 77309411328
- -409> 2019-11-07 10:50:20.355 7f118e4d5700 10 set_mon_vals bluestore_bluefs_gift_ratio = 0.002000
- -408> 2019-11-07 10:50:20.355 7f118e4d5700 10 set_mon_vals cluster_network = 192.168.7.0/24
- -407> 2019-11-07 10:50:20.355 7f118e4d5700 10 set_mon_vals debug_bluestore = 0/0
- -406> 2019-11-07 10:50:20.355 7f118fcd8700 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1
- -405> 2019-11-07 10:50:20.355 7f118e4d5700 10 set_mon_vals debug_journal = 0/0
- -404> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding auth protocol: cephx
- -403> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding auth protocol: cephx
- -402> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding auth protocol: cephx
- -401> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding con mode: secure
- -400> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding con mode: crc
- -399> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding con mode: secure
- -398> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding con mode: crc
- -397> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding con mode: secure
- -396> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding con mode: crc
- -395> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding con mode: crc
- -394> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding con mode: secure
- -393> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding con mode: crc
- -392> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding con mode: secure
- -391> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding con mode: crc
- -390> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0xd10c140) adding con mode: secure
- -389> 2019-11-07 10:50:20.355 7f118e4d5700 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
- -388> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding auth protocol: cephx
- -387> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding auth protocol: cephx
- -386> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding auth protocol: cephx
- -385> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: secure
- -384> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: crc
- -383> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: secure
- -382> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: crc
- -381> 2019-11-07 10:50:20.355 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: secure
- -380> 2019-11-07 10:50:20.359 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: crc
- -379> 2019-11-07 10:50:20.359 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: crc
- -378> 2019-11-07 10:50:20.359 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: secure
- -377> 2019-11-07 10:50:20.359 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: crc
- -376> 2019-11-07 10:50:20.359 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: secure
- -375> 2019-11-07 10:50:20.359 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: crc
- -374> 2019-11-07 10:50:20.359 7f118e4d5700 5 AuthRegistry(0x7ffcf6d321c8) adding con mode: secure
- -373> 2019-11-07 10:50:20.359 7f118e4d5700 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
- -372> 2019-11-07 10:50:20.359 7f1196326f80 0 set uid:gid to 64045:64045 (ceph:ceph)
- -371> 2019-11-07 10:50:20.359 7f1196326f80 0 ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable), process ceph-osd, pid 159515
- -370> 2019-11-07 10:50:20.359 7f1196326f80 0 pidfile_write: ignore empty --pid-file
- -369> 2019-11-07 10:50:20.359 7f1196326f80 5 asok(0xc52e000) init /var/run/ceph/ceph-osd.22.asok
- -368> 2019-11-07 10:50:20.359 7f1196326f80 5 asok(0xc52e000) bind_and_listen /var/run/ceph/ceph-osd.22.asok
- -367> 2019-11-07 10:50:20.359 7f1196326f80 5 asok(0xc52e000) register_command 0 hook 0xc45ed38
- -366> 2019-11-07 10:50:20.359 7f1196326f80 5 asok(0xc52e000) register_command version hook 0xc45ed38
- -365> 2019-11-07 10:50:20.359 7f1196326f80 5 asok(0xc52e000) register_command git_version hook 0xc45ed38
- -364> 2019-11-07 10:50:20.359 7f1196326f80 5 asok(0xc52e000) register_command help hook 0xc462280
- -363> 2019-11-07 10:50:20.359 7f1196326f80 5 asok(0xc52e000) register_command get_command_descriptions hook 0xc4622d0
- -362> 2019-11-07 10:50:20.359 7f118ecd6700 5 asok(0xc52e000) entry start
- -361> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
- -360> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
- -359> 2019-11-07 10:50:20.399 7f1196326f80 0 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
- -358> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
- -357> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block.db type kernel
- -356> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block.db) open path /var/lib/ceph/osd/ceph-22/block.db
- -355> 2019-11-07 10:50:20.399 7f1196326f80 0 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.db failed: (22) Invalid argument
- -354> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block.db) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
- -353> 2019-11-07 10:50:20.399 7f1196326f80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-22/block.db size 1 GiB
- -352> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
- -351> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
- -350> 2019-11-07 10:50:20.399 7f1196326f80 0 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
- -349> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
- -348> 2019-11-07 10:50:20.399 7f1196326f80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-22/block size 5.5 TiB
- -347> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block.wal type kernel
- -346> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.wal) open path /var/lib/ceph/osd/ceph-22/block.wal
- -345> 2019-11-07 10:50:20.399 7f1196326f80 0 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.wal failed: (22) Invalid argument
- -344> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.wal) open size 603979776 (0x24000000, 576 MiB) block_size 4096 (4 KiB) non-rotational discard supported
- -343> 2019-11-07 10:50:20.399 7f1196326f80 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-22/block.wal size 576 MiB
- -342> 2019-11-07 10:50:20.399 7f1196326f80 1 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.wal) close
- -341> 2019-11-07 10:50:20.679 7f1196326f80 1 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block.db) close
- -340> 2019-11-07 10:50:20.935 7f1196326f80 1 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block) close
- -339> 2019-11-07 10:50:21.179 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) close
- -338> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding auth protocol: cephx
- -337> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding auth protocol: cephx
- -336> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding auth protocol: cephx
- -335> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding con mode: secure
- -334> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding con mode: crc
- -333> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding con mode: secure
- -332> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding con mode: crc
- -331> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding con mode: secure
- -330> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding con mode: crc
- -329> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding con mode: crc
- -328> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding con mode: secure
- -327> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding con mode: crc
- -326> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding con mode: secure
- -325> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding con mode: crc
- -324> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ca40) adding con mode: secure
- -323> 2019-11-07 10:50:21.439 7f1196326f80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
- -322> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding auth protocol: cephx
- -321> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding auth protocol: cephx
- -320> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding auth protocol: cephx
- -319> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: secure
- -318> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: crc
- -317> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: secure
- -316> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: crc
- -315> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: secure
- -314> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: crc
- -313> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: crc
- -312> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: secure
- -311> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: crc
- -310> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: secure
- -309> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: crc
- -308> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10c140) adding con mode: secure
- -307> 2019-11-07 10:50:21.439 7f1196326f80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
- -306> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding auth protocol: cephx
- -305> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding auth protocol: cephx
- -304> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding auth protocol: cephx
- -303> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding con mode: secure
- -302> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding con mode: crc
- -301> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding con mode: secure
- -300> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding con mode: crc
- -299> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding con mode: secure
- -298> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding con mode: crc
- -297> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding con mode: crc
- -296> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding con mode: secure
- -295> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding con mode: crc
- -294> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding con mode: secure
- -293> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding con mode: crc
- -292> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10d340) adding con mode: secure
- -291> 2019-11-07 10:50:21.439 7f1196326f80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
- -290> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding auth protocol: cephx
- -289> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding auth protocol: cephx
- -288> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding auth protocol: cephx
- -287> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding con mode: secure
- -286> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding con mode: crc
- -285> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding con mode: secure
- -284> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding con mode: crc
- -283> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding con mode: secure
- -282> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding con mode: crc
- -281> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding con mode: crc
- -280> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding con mode: secure
- -279> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding con mode: crc
- -278> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding con mode: secure
- -277> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding con mode: crc
- -276> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10dc40) adding con mode: secure
- -275> 2019-11-07 10:50:21.439 7f1196326f80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
- -274> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding auth protocol: cephx
- -273> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding auth protocol: cephx
- -272> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding auth protocol: cephx
- -271> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding con mode: secure
- -270> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding con mode: crc
- -269> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding con mode: secure
- -268> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding con mode: crc
- -267> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding con mode: secure
- -266> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding con mode: crc
- -265> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding con mode: crc
- -264> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding con mode: secure
- -263> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding con mode: crc
- -262> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding con mode: secure
- -261> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding con mode: crc
- -260> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10e540) adding con mode: secure
- -259> 2019-11-07 10:50:21.439 7f1196326f80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
- -258> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding auth protocol: cephx
- -257> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding auth protocol: cephx
- -256> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding auth protocol: cephx
- -255> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding con mode: secure
- -254> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding con mode: crc
- -253> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding con mode: secure
- -252> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding con mode: crc
- -251> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding con mode: secure
- -250> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding con mode: crc
- -249> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding con mode: crc
- -248> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding con mode: secure
- -247> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding con mode: crc
- -246> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding con mode: secure
- -245> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding con mode: crc
- -244> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10ee40) adding con mode: secure
- -243> 2019-11-07 10:50:21.439 7f1196326f80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
- -242> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding auth protocol: cephx
- -241> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding auth protocol: cephx
- -240> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding auth protocol: cephx
- -239> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding con mode: secure
- -238> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding con mode: crc
- -237> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding con mode: secure
- -236> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding con mode: crc
- -235> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding con mode: secure
- -234> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding con mode: crc
- -233> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding con mode: crc
- -232> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding con mode: secure
- -231> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding con mode: crc
- -230> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding con mode: secure
- -229> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding con mode: crc
- -228> 2019-11-07 10:50:21.439 7f1196326f80 5 AuthRegistry(0xd10f740) adding con mode: secure
- -227> 2019-11-07 10:50:21.439 7f1196326f80 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-22/keyring
- -226> 2019-11-07 10:50:21.439 7f1196326f80 0 starting osd.22 osd_data /var/lib/ceph/osd/ceph-22 /var/lib/ceph/osd/ceph-22/journal
- -225> 2019-11-07 10:50:21.475 7f1196326f80 0 load: jerasure load: lrc load: isa
- -224> 2019-11-07 10:50:21.475 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
- -223> 2019-11-07 10:50:21.475 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
- -222> 2019-11-07 10:50:21.475 7f1196326f80 0 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
- -221> 2019-11-07 10:50:21.475 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
- -220> 2019-11-07 10:50:21.479 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) close
- -219> 2019-11-07 10:50:21.759 7f1196326f80 5 asok(0xc52e000) register_command objecter_requests hook 0xc462ab0
- -218> 2019-11-07 10:50:21.759 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
- -217> 2019-11-07 10:50:21.759 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
- -216> 2019-11-07 10:50:21.759 7f1196326f80 0 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
- -215> 2019-11-07 10:50:21.759 7f1196326f80 1 bdev(0xd13c000 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
- -214> 2019-11-07 10:50:21.763 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block.db type kernel
- -213> 2019-11-07 10:50:21.763 7f1196326f80 1 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.db) open path /var/lib/ceph/osd/ceph-22/block.db
- -212> 2019-11-07 10:50:21.763 7f1196326f80 0 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.db) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.db failed: (22) Invalid argument
- -211> 2019-11-07 10:50:21.763 7f1196326f80 1 bdev(0xd13ce00 /var/lib/ceph/osd/ceph-22/block.db) open size 1073741824 (0x40000000, 1 GiB) block_size 4096 (4 KiB) non-rotational discard supported
- -210> 2019-11-07 10:50:21.763 7f1196326f80 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-22/block.db size 1 GiB
- -209> 2019-11-07 10:50:21.763 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block type kernel
- -208> 2019-11-07 10:50:21.763 7f1196326f80 1 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block) open path /var/lib/ceph/osd/ceph-22/block
- -207> 2019-11-07 10:50:21.763 7f1196326f80 0 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block failed: (22) Invalid argument
- -206> 2019-11-07 10:50:21.763 7f1196326f80 1 bdev(0xd13c700 /var/lib/ceph/osd/ceph-22/block) open size 6001069199360 (0x5753b991000, 5.5 TiB) block_size 4096 (4 KiB) rotational discard not supported
- -205> 2019-11-07 10:50:21.763 7f1196326f80 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-22/block size 5.5 TiB
- -204> 2019-11-07 10:50:21.763 7f1196326f80 1 bdev create path /var/lib/ceph/osd/ceph-22/block.wal type kernel
- -203> 2019-11-07 10:50:21.763 7f1196326f80 1 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block.wal) open path /var/lib/ceph/osd/ceph-22/block.wal
- -202> 2019-11-07 10:50:21.763 7f1196326f80 0 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block.wal) ioctl(F_SET_FILE_RW_HINT) on /var/lib/ceph/osd/ceph-22/block.wal failed: (22) Invalid argument
- -201> 2019-11-07 10:50:21.763 7f1196326f80 1 bdev(0xd13ca80 /var/lib/ceph/osd/ceph-22/block.wal) open size 603979776 (0x24000000, 576 MiB) block_size 4096 (4 KiB) non-rotational discard supported
- -200> 2019-11-07 10:50:21.763 7f1196326f80 1 bluefs add_block_device bdev 0 path /var/lib/ceph/osd/ceph-22/block.wal size 576 MiB
- -199> 2019-11-07 10:50:21.763 7f1196326f80 1 bluefs mount
- -198> 2019-11-07 10:50:21.787 7f1196326f80 0 set rocksdb option compaction_readahead_size = 2097152
- -197> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option compression = kNoCompression
- -196> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option max_background_compactions = 2
- -195> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option max_write_buffer_number = 4
- -194> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option min_write_buffer_number_to_merge = 1
- -193> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option recycle_log_file_num = 4
- -192> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option writable_file_max_buffer_size = 0
- -191> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option write_buffer_size = 268435456
- -190> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option compaction_readahead_size = 2097152
- -189> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option compression = kNoCompression
- -188> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option max_background_compactions = 2
- -187> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option max_write_buffer_number = 4
- -186> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option min_write_buffer_number_to_merge = 1
- -185> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option recycle_log_file_num = 4
- -184> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option writable_file_max_buffer_size = 0
- -183> 2019-11-07 10:50:21.791 7f1196326f80 0 set rocksdb option write_buffer_size = 268435456
- -182> 2019-11-07 10:50:21.791 7f1196326f80 1 rocksdb: do_open column families: [default]
- -181> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: RocksDB version: 6.1.2
- -180> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
- -179> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Compile date Sep 13 2019
- -178> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: DB SUMMARY
- -177> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: CURRENT file: CURRENT
- -176> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: IDENTITY file: IDENTITY
- -175> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: MANIFEST file: MANIFEST-034878 size: 269419 Bytes
- -174> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: SST files in db dir, Total Num: 7, files: 036855.sst 036856.sst 036858.sst 036859.sst 036886.sst 036888.sst 036890.sst
- -173> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: SST files in db.slow dir, Total Num: 182, files: 033490.sst 033491.sst 033632.sst 034662.sst 034717.sst 034718.sst 034719.sst 034769.sst 034770.sst
- -172> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Write Ahead Log file in db.wal: 036887.log size: 253533899 ; 036889.log size: 255973165 ;
- -171> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.error_if_exists: 0
- -170> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.create_if_missing: 0
- -169> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.paranoid_checks: 1
- -168> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.env: 0xd416120
- -167> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.info_log: 0xd418640
- -166> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_file_opening_threads: 16
- -165> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.statistics: (nil)
- -164> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.use_fsync: 0
- -163> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_log_file_size: 0
- -162> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_manifest_file_size: 1073741824
- -161> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.log_file_time_to_roll: 0
- -160> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.keep_log_file_num: 1000
- -159> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.recycle_log_file_num: 4
- -158> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.allow_fallocate: 1
- -157> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.allow_mmap_reads: 0
- -156> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.allow_mmap_writes: 0
- -155> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.use_direct_reads: 0
- -154> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- -153> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.create_missing_column_families: 0
- -152> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.db_log_dir:
- -151> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.wal_dir: db.wal
- -150> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.table_cache_numshardbits: 6
- -149> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_subcompactions: 1
- -148> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_background_flushes: -1
- -147> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.WAL_ttl_seconds: 0
- -146> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.WAL_size_limit_MB: 0
- -145> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.manifest_preallocation_size: 4194304
- -144> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.is_fd_close_on_exec: 1
- -143> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.advise_random_on_open: 1
- -142> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.db_write_buffer_size: 0
- -141> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.write_buffer_manager: 0xd144f00
- -140> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.access_hint_on_compaction_start: 1
- -139> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
- -138> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- -137> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.use_adaptive_mutex: 0
- -136> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.rate_limiter: (nil)
- -135> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- -134> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.wal_recovery_mode: 0
- -133> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.enable_thread_tracking: 0
- -132> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.enable_pipelined_write: 0
- -131> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- -130> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- -129> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.write_thread_max_yield_usec: 100
- -128> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- -127> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.row_cache: None
- -126> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.wal_filter: None
- -125> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.avoid_flush_during_recovery: 0
- -124> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.allow_ingest_behind: 0
- -123> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.preserve_deletes: 0
- -122> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.two_write_queues: 0
- -121> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.manual_wal_flush: 0
- -120> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.atomic_flush: 0
- -119> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0
- -118> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_background_jobs: 2
- -117> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_background_compactions: 2
- -116> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- -115> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.writable_file_max_buffer_size: 0
- -114> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.delayed_write_rate : 16777216
- -113> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_total_wal_size: 0
- -112> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- -111> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.stats_dump_period_sec: 600
- -110> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.stats_persist_period_sec: 600
- -109> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.stats_history_buffer_size: 1048576
- -108> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_open_files: -1
- -107> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bytes_per_sync: 0
- -106> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.wal_bytes_per_sync: 0
- -105> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_readahead_size: 2097152
- -104> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Compression algorithms supported:
- -103> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kZSTDNotFinalCompression supported: 0
- -102> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kZSTD supported: 0
- -101> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kXpressCompression supported: 0
- -100> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kLZ4HCCompression supported: 1
- -99> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kLZ4Compression supported: 1
- -98> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kBZip2Compression supported: 0
- -97> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kZlibCompression supported: 1
- -96> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: kSnappyCompression supported: 1
- -95> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Fast CRC32 supported: Supported on x86
- -94> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: [db/db_impl_readonly.cc:22] Opening the db in read only mode
- -93> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: db/MANIFEST-034878
- -92> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]:
- -91> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- -90> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
- -89> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_filter: None
- -88> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_filter_factory: None
- -87> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.memtable_factory: SkipListFactory
- -86> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.table_factory: BlockBasedTable
- -85> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0xc460100)
- cache_index_and_filter_blocks: 1
- cache_index_and_filter_blocks_with_high_priority: 1
- pin_l0_filter_and_index_blocks_in_cache: 1
- pin_top_level_index_and_filter: 1
- index_type: 0
- data_block_index_type: 0
- data_block_hash_table_util_ratio: 0.750000
- hash_index_allow_collision: 1
- checksum: 1
- no_block_cache: 0
- block_cache: 0xc4829d0
- block_cache_name: BinnedLRUCache
- block_cache_options:
- capacity : 429496729
- num_shard_bits : 4
- strict_capacity_limit : 0
- high_pri_pool_ratio: 0.000
- block_cache_compressed: (nil)
- persistent_cache: (nil)
- block_size: 4096
- block_size_deviation: 10
- block_restart_interval: 16
- index_block_restart_interval: 1
- metadata_block_size: 4096
- partition_filters: 0
- use_delta_encoding: 1
- filter_policy: rocksdb.BuiltinBloomFilter
- whole_key_filtering: 1
- verify_compression: 0
- read_amp_bytes_per_bit: 0
- format_version: 2
- enable_index_compression: 1
- block_align: 0
- -84> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.write_buffer_size: 268435456
- -83> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_write_buffer_number: 4
- -82> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression: NoCompression
- -81> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression: Disabled
- -80> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.prefix_extractor: nullptr
- -79> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- -78> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.num_levels: 7
- -77> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- -76> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- -75> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14
- -74> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression_opts.level: 32767
- -73> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0
- -72> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0
- -71> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0
- -70> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bottommost_compression_opts.enabled: false
- -69> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression_opts.window_bits: -14
- -68> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression_opts.level: 32767
- -67> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression_opts.strategy: 0
- -66> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- -65> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0
- -64> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compression_opts.enabled: false
- -63> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- -62> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- -61> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.level0_stop_writes_trigger: 36
- -60> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.target_file_size_base: 67108864
- -59> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.target_file_size_multiplier: 1
- -58> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- -57> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- -56> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- -55> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- -54> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- -53> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- -52> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- -51> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- -50> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- -49> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- -48> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- -47> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_compaction_bytes: 1677721600
- -46> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.arena_block_size: 33554432
- -45> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- -44> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- -43> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- -42> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.disable_auto_compactions: 0
- -41> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- -40> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio
- -39> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- -38> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- -37> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- -36> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- -35> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- -34> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
- -33> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- -32> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0
- -31> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.table_properties_collectors:
- -30> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.inplace_update_support: 0
- -29> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.inplace_update_num_locks: 10000
- -28> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- -27> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.memtable_whole_key_filtering: 0
- -26> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.memtable_huge_page_size: 0
- -25> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.bloom_locality: 0
- -24> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.max_successive_merges: 0
- -23> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.optimize_filters_for_hits: 0
- -22> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.paranoid_file_checks: 0
- -21> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.force_consistency_checks: 0
- -20> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.report_bg_io_stats: 0
- -19> 2019-11-07 10:50:21.795 7f1196326f80 4 rocksdb: Options.ttl: 0
- -18> 2019-11-07 10:50:21.799 7f1180b0b700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 177636318 in db/036858.sst offset 18446744073709551615 size 18446744073709551615
- -17> 2019-11-07 10:50:21.799 7f1182b0f700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 2028823508 in db/036890.sst offset 18446744073709551615 size 18446744073709551615
- -16> 2019-11-07 10:50:21.799 7f118230e700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 994402680 in db/036888.sst offset 18446744073709551615 size 18446744073709551615
- -15> 2019-11-07 10:50:21.799 7f1181b0d700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 581611736 in db/036886.sst offset 18446744073709551615 size 18446744073709551615
- -14> 2019-11-07 10:50:22.319 7f118230e700 3 rocksdb: [table/block_based_table_reader.cc:1117] Encountered error while reading data from compression dictionary block Corruption: block checksum mismatch: expected 0, got 184561374 in db.slow/036824.sst offset 18446744073709551615 size 18446744073709551615
- -13> 2019-11-07 10:50:22.395 7f1196326f80 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:db/MANIFEST-034878 succeeded,manifest_file_number is 34878, next_file_number is 36892, last_sequence is 1244403827, log_number is 36889,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
- -12> 2019-11-07 10:50:22.395 7f1196326f80 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 36889
- -11> 2019-11-07 10:50:22.395 7f1196326f80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1573116622399672, "job": 1, "event": "recovery_started", "log_files": [36887, 36889]}
- -10> 2019-11-07 10:50:22.395 7f1196326f80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #36887 mode 0
- -9> 2019-11-07 10:50:23.231 7f1196326f80 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #36889 mode 0
- -8> 2019-11-07 10:50:25.095 7f1196326f80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1573116625098605, "job": 1, "event": "recovery_finished"}
- -7> 2019-11-07 10:50:25.227 7f1196326f80 1 get compressor snappy = 0
- -6> 2019-11-07 10:50:25.227 7f1196326f80 1 load compressor snappy
- -5> 2019-11-07 10:50:25.235 7f1196326f80 1 add compressor snappy 0xd147ea0
- -4> 2019-11-07 10:50:25.235 7f1196326f80 1 get compressor snappy = 0xd147ea0
- -3> 2019-11-07 10:50:25.235 7f1196326f80 1 load: compressor snappy loaded and registered
- -2> 2019-11-07 10:50:25.235 7f1196326f80 1 get compressor snappy = 0xd147ea0
- -1> 2019-11-07 10:50:25.299 7f1196326f80 -1 /build/ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: In function 'void AllocatorLevel02<T>::_mark_allocated(uint64_t, uint64_t) [with L1 = AllocatorLevel01Loose; uint64_t = long unsigned int]' thread 7f1196326f80 time 2019-11-07 10:50:25.298070
- /build/ceph-14.2.4/src/os/bluestore/fastbmap_allocator_impl.h: 750: FAILED ceph_assert(available >= allocated)
- ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable)
- 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x85c3c8]
- 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x85c5a3]
- 3: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0xeb665c]
- 4: (BlueStore::_open_alloc()+0x445) [0xd55345]
- 5: (BlueStore::_open_db_and_around(bool)+0x146) [0xd70396]
- 6: (BlueStore::_mount(bool, bool)+0x68a) [0xdbc55a]
- 7: (OSD::init()+0x3b7) [0x909087]
- 8: (main()+0x40d8) [0x863d38]
- 9: (__libc_start_main()+0xf0) [0x7f11930c8830]
- 10: (_start()+0x29) [0x896cb9]
- 0> 2019-11-07 10:50:25.303 7f1196326f80 -1 *** Caught signal (Aborted) **
- in thread 7f1196326f80 thread_name:ceph-osd
- ceph version 14.2.4 (75f4de193b3ea58512f204623e6c5a16e6c1e1ba) nautilus (stable)
- 1: (()+0x11390) [0x7f1193bb2390]
- 2: (gsignal()+0x38) [0x7f11930dd428]
- 3: (abort()+0x16a) [0x7f11930df02a]
- 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x85c419]
- 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x85c5a3]
- 6: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0xeb665c]
- 7: (BlueStore::_open_alloc()+0x445) [0xd55345]
- 8: (BlueStore::_open_db_and_around(bool)+0x146) [0xd70396]
- 9: (BlueStore::_mount(bool, bool)+0x68a) [0xdbc55a]
- 10: (OSD::init()+0x3b7) [0x909087]
- 11: (main()+0x40d8) [0x863d38]
- 12: (__libc_start_main()+0xf0) [0x7f11930c8830]
- 13: (_start()+0x29) [0x896cb9]
- NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- --- logging levels ---
- 0/ 5 none
- 0/ 1 lockdep
- 0/ 1 context
- 1/ 1 crush
- 1/ 5 mds
- 1/ 5 mds_balancer
- 1/ 5 mds_locker
- 1/ 5 mds_log
- 1/ 5 mds_log_expire
- 1/ 5 mds_migrator
- 0/ 1 buffer
- 0/ 1 timer
- 0/ 1 filer
- 0/ 1 striper
- 0/ 1 objecter
- 0/ 5 rados
- 0/ 5 rbd
- 0/ 5 rbd_mirror
- 0/ 5 rbd_replay
- 0/ 5 journaler
- 0/ 5 objectcacher
- 0/ 5 client
- 0/ 0 osd
- 0/ 5 optracker
- 0/ 5 objclass
- 1/ 3 filestore
- 0/ 0 journal
- 0/ 0 ms
- 1/ 5 mon
- 0/ 0 monc
- 1/ 5 paxos
- 0/ 5 tp
- 1/ 5 auth
- 1/ 5 crypto
- 1/ 1 finisher
- 1/ 1 reserver
- 1/ 5 heartbeatmap
- 1/ 5 perfcounter
- 1/ 5 rgw
- 1/ 5 rgw_sync
- 1/10 civetweb
- 1/ 5 javaclient
- 1/ 5 asok
- 1/ 1 throttle
- 0/ 0 refs
- 1/ 5 xio
- 1/ 5 compressor
- 0/ 0 bluestore
- 1/ 5 bluefs
- 1/ 3 bdev
- 1/ 5 kstore
- 4/ 5 rocksdb
- 4/ 5 leveldb
- 4/ 5 memdb
- 1/ 5 kinetic
- 1/ 5 fuse
- 1/ 5 mgr
- 1/ 5 mgrc
- 1/ 5 dpdk
- 1/ 5 eventtrace
- -2/-2 (syslog threshold)
- -1/-1 (stderr threshold)
- max_recent 10000
- max_new 1000
- log_file /var/log/ceph/ceph-osd.22.log
- --- end dump of recent events ---
Advertisement
Add Comment
Please, Sign In to add comment