Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- Jeffs-MacBook-Air:~ jmasud$ kubectl -n rook logs rook-ceph-mon0-8khz6
- 2018-04-17 04:35:17.285811 I | rook: starting Rook v0.7.0-40.g284c1b3 with arguments '/usr/local/bin/rook mon --config-dir=/var/lib/rook --name=rook-ceph-mon0 --port=6790 --fsid=d4f1a1ca-b919-4c5b-89f2-1aed3d913a97'
- 2018-04-17 04:35:17.285965 I | rook: flag values: --admin-secret=*****, --ceph-config-override=/etc/rook/config/override.conf, --cluster-name=rook, --config-dir=/var/lib/rook, --fsid=d4f1a1ca-b919-4c5b-89f2-1aed3d913a97, --help=false, --log-level=INFO, --mon-endpoints=rook-ceph-mon0=10.107.181.203:6790,rook-ceph-mon1=10.97.51.86:6790,rook-ceph-mon2=10.111.191.96:6790, --mon-secret=*****, --name=rook-ceph-mon0, --port=6790, --private-ipv4=192.168.33.45, --public-ipv4=10.107.181.203
- 2018-04-17 04:35:17.286107 I | rook: cached mon secret matches the expected keyring
- 2018-04-17 04:35:17.286135 I | cephmon: parsing mon endpoints: rook-ceph-mon0=10.107.181.203:6790,rook-ceph-mon1=10.97.51.86:6790,rook-ceph-mon2=10.111.191.96:6790
- 2018-04-17 04:35:17.286937 I | cephmon: writing config file /var/lib/rook/rook-ceph-mon0/rook.config
- 2018-04-17 04:35:17.287429 I | cephmon: initializing mon
- 2018-04-17 04:35:17.287476 I | exec: Running command: monmaptool /var/lib/rook/rook-ceph-mon0/monmap --create --clobber --fsid d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 --add rook-ceph-mon2 10.111.191.96:6790 --add rook-ceph-mon0 10.107.181.203:6790 --add rook-ceph-mon1 10.97.51.86:6790
- 2018-04-17 04:35:17.348735 I | monmaptool: monmap file /var/lib/rook/rook-ceph-mon0/monmap
- 2018-04-17 04:35:17.348771 I | monmaptool: set fsid to d4f1a1ca-b919-4c5b-89f2-1aed3d913a97
- 2018-04-17 04:35:17.348790 I | monmaptool: writing epoch 0 to /var/lib/rook/rook-ceph-mon0/monmap (3 monitors)
- 2018-04-17 04:35:17.354121 I | exec: Running command: ceph-mon --mkfs --name=mon.rook-ceph-mon0 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon0/data --conf=/var/lib/rook/rook-ceph-mon0/rook.config --keyring=/var/lib/rook/rook-ceph-mon0/keyring --monmap=/var/lib/rook/rook-ceph-mon0/monmap
- 2018-04-17 04:35:17.399292 I | mkfs-rook-ceph-mon0: 2018-04-17 04:35:17.398868 7fe253f26f00 -1 '/var/lib/rook/rook-ceph-mon0/data' already exists and is not empty: monitor may already exist
- 2018-04-17 04:35:17.403800 I | mkfs-rook-ceph-mon0: 2018-04-17 04:35:17.398868 7fe253f26f00 -1 '/var/lib/rook/rook-ceph-mon0/data' already exists and is not empty: monitor may already exist
- 2018-04-17 04:35:17.403905 I | cephmon: starting mon
- 2018-04-17 04:35:17.403992 I | cephmon: Config file /var/lib/rook/rook-ceph-mon0/rook.config:
- [global]
- fsid = d4f1a1ca-b919-4c5b-89f2-1aed3d913a97
- run dir = /var/lib/rook/rook-ceph-mon0
- mon initial members = rook-ceph-mon0 rook-ceph-mon1 rook-ceph-mon2
- mon host = 10.107.181.203:6790,10.97.51.86:6790,10.111.191.96:6790
- log file = /dev/stdout
- mon cluster log file = /dev/stdout
- public addr = 10.107.181.203
- cluster addr = 192.168.33.45
- mon keyvaluedb = rocksdb
- mon_allow_pool_delete = true
- mon_max_pg_per_osd = 1000
- debug default = 0
- debug rados = 0
- debug mon = 0
- debug osd = 0
- debug bluestore = 0
- debug filestore = 0
- debug journal = 0
- debug leveldb = 0
- filestore_omap_backend = rocksdb
- osd pg bits = 11
- osd pgp bits = 11
- osd pool default size = 1
- osd pool default min size = 1
- osd pool default pg num = 100
- osd pool default pgp num = 100
- osd objectstore =
- rbd_default_features = 3
- fatal signal handlers = false
- [client.admin]
- keyring = /var/lib/rook/rook-ceph-mon0/keyring
- 2018-04-17 04:35:17.404038 I | exec: Running command: ceph-mon --foreground --name=mon.rook-ceph-mon0 --cluster=rook --mon-data=/var/lib/rook/rook-ceph-mon0/data --conf=/var/lib/rook/rook-ceph-mon0/rook.config --keyring=/var/lib/rook/rook-ceph-mon0/keyring --public-addr=10.107.181.203:6790 --public-bind-addr=192.168.33.45:6790
- 2018-04-17 04:35:17.446418 I | rook-ceph-mon0: 2018-04-17 04:35:17.446196 7f383871cf00 0 ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable), process (unknown), pid 18
- 2018-04-17 04:35:17.446460 I | rook-ceph-mon0: 2018-04-17 04:35:17.446341 7f383871cf00 0 pidfile_write: ignore empty --pid-file
- 2018-04-17 04:35:17.460011 I | rook-ceph-mon0: 2018-04-17 04:35:17.459828 7f383871cf00 0 load: jerasure load: lrc load: isa
- 2018-04-17 04:35:17.460209 I | rook-ceph-mon0: 2018-04-17 04:35:17.460025 7f383871cf00 0 set rocksdb option compression = kNoCompression
- 2018-04-17 04:35:17.460266 I | rook-ceph-mon0: 2018-04-17 04:35:17.460052 7f383871cf00 0 set rocksdb option write_buffer_size = 33554432
- 2018-04-17 04:35:17.460287 I | rook-ceph-mon0: 2018-04-17 04:35:17.460077 7f383871cf00 0 set rocksdb option compression = kNoCompression
- 2018-04-17 04:35:17.460339 I | rook-ceph-mon0: 2018-04-17 04:35:17.460085 7f383871cf00 0 set rocksdb option write_buffer_size = 33554432
- 2018-04-17 04:35:17.460815 I | rook-ceph-mon0: 2018-04-17 04:35:17.460312 7f383871cf00 4 rocksdb: RocksDB version: 5.4.0
- 2018-04-17 04:35:17.460871 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.460895 I | rook-ceph-mon0: 2018-04-17 04:35:17.460338 7f383871cf00 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
- 2018-04-17 04:35:17.460916 I | rook-ceph-mon0: 2018-04-17 04:35:17.460343 7f383871cf00 4 rocksdb: Compile date Feb 26 2018
- 2018-04-17 04:35:17.460936 I | rook-ceph-mon0: 2018-04-17 04:35:17.460346 7f383871cf00 4 rocksdb: DB SUMMARY
- 2018-04-17 04:35:17.460953 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.460973 I | rook-ceph-mon0: 2018-04-17 04:35:17.460435 7f383871cf00 4 rocksdb: CURRENT file: CURRENT
- 2018-04-17 04:35:17.460993 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.461012 I | rook-ceph-mon0: 2018-04-17 04:35:17.460441 7f383871cf00 4 rocksdb: IDENTITY file: IDENTITY
- 2018-04-17 04:35:17.461970 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.462011 I | rook-ceph-mon0: 2018-04-17 04:35:17.460459 7f383871cf00 4 rocksdb: MANIFEST file: MANIFEST-001629 size: 183 Bytes
- 2018-04-17 04:35:17.462059 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.462082 I | rook-ceph-mon0: 2018-04-17 04:35:17.460464 7f383871cf00 4 rocksdb: SST files in /var/lib/rook/rook-ceph-mon0/data/store.db dir, Total Num: 2, files: 001626.sst 001628.sst
- 2018-04-17 04:35:17.462101 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.462121 I | rook-ceph-mon0: 2018-04-17 04:35:17.460469 7f383871cf00 4 rocksdb: Write Ahead Log file in /var/lib/rook/rook-ceph-mon0/data/store.db: 001630.log size: 449 ;
- 2018-04-17 04:35:17.462140 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.462159 I | rook-ceph-mon0: 2018-04-17 04:35:17.460472 7f383871cf00 4 rocksdb: Options.error_if_exists: 0
- 2018-04-17 04:35:17.462187 I | rook-ceph-mon0: 2018-04-17 04:35:17.460475 7f383871cf00 4 rocksdb: Options.create_if_missing: 0
- 2018-04-17 04:35:17.462207 I | rook-ceph-mon0: 2018-04-17 04:35:17.460478 7f383871cf00 4 rocksdb: Options.paranoid_checks: 1
- 2018-04-17 04:35:17.462227 I | rook-ceph-mon0: 2018-04-17 04:35:17.460481 7f383871cf00 4 rocksdb: Options.env: 0x55d38fe0ef20
- 2018-04-17 04:35:17.462255 I | rook-ceph-mon0: 2018-04-17 04:35:17.460484 7f383871cf00 4 rocksdb: Options.info_log: 0x55d3911c67c0
- 2018-04-17 04:35:17.462275 I | rook-ceph-mon0: 2018-04-17 04:35:17.460486 7f383871cf00 4 rocksdb: Options.max_open_files: -1
- 2018-04-17 04:35:17.462296 I | rook-ceph-mon0: 2018-04-17 04:35:17.460490 7f383871cf00 4 rocksdb: Options.max_file_opening_threads: 16
- 2018-04-17 04:35:17.462316 I | rook-ceph-mon0: 2018-04-17 04:35:17.460492 7f383871cf00 4 rocksdb: Options.use_fsync: 0
- 2018-04-17 04:35:17.462344 I | rook-ceph-mon0: 2018-04-17 04:35:17.460495 7f383871cf00 4 rocksdb: Options.max_log_file_size: 0
- 2018-04-17 04:35:17.462379 I | rook-ceph-mon0: 2018-04-17 04:35:17.460498 7f383871cf00 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2018-04-17 04:35:17.462399 I | rook-ceph-mon0: 2018-04-17 04:35:17.460501 7f383871cf00 4 rocksdb: Options.log_file_time_to_roll: 0
- 2018-04-17 04:35:17.462420 I | rook-ceph-mon0: 2018-04-17 04:35:17.460504 7f383871cf00 4 rocksdb: Options.keep_log_file_num: 1000
- 2018-04-17 04:35:17.462445 I | rook-ceph-mon0: 2018-04-17 04:35:17.460506 7f383871cf00 4 rocksdb: Options.recycle_log_file_num: 0
- 2018-04-17 04:35:17.462465 I | rook-ceph-mon0: 2018-04-17 04:35:17.460509 7f383871cf00 4 rocksdb: Options.allow_fallocate: 1
- 2018-04-17 04:35:17.462486 I | rook-ceph-mon0: 2018-04-17 04:35:17.460538 7f383871cf00 4 rocksdb: Options.allow_mmap_reads: 0
- 2018-04-17 04:35:17.462506 I | rook-ceph-mon0: 2018-04-17 04:35:17.460543 7f383871cf00 4 rocksdb: Options.allow_mmap_writes: 0
- 2018-04-17 04:35:17.462527 I | rook-ceph-mon0: 2018-04-17 04:35:17.460545 7f383871cf00 4 rocksdb: Options.use_direct_reads: 0
- 2018-04-17 04:35:17.462546 I | rook-ceph-mon0: 2018-04-17 04:35:17.460548 7f383871cf00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2018-04-17 04:35:17.462564 I | rook-ceph-mon0: 2018-04-17 04:35:17.460551 7f383871cf00 4 rocksdb: Options.create_missing_column_families: 0
- 2018-04-17 04:35:17.462582 I | rook-ceph-mon0: 2018-04-17 04:35:17.460553 7f383871cf00 4 rocksdb: Options.db_log_dir:
- 2018-04-17 04:35:17.462602 I | rook-ceph-mon0: 2018-04-17 04:35:17.460556 7f383871cf00 4 rocksdb: Options.wal_dir: /var/lib/rook/rook-ceph-mon0/data/store.db
- 2018-04-17 04:35:17.462628 I | rook-ceph-mon0: 2018-04-17 04:35:17.460559 7f383871cf00 4 rocksdb: Options.table_cache_numshardbits: 6
- 2018-04-17 04:35:17.462781 I | rook-ceph-mon0: 2018-04-17 04:35:17.460562 7f383871cf00 4 rocksdb: Options.max_subcompactions: 1
- 2018-04-17 04:35:17.462844 I | rook-ceph-mon0: 2018-04-17 04:35:17.460565 7f383871cf00 4 rocksdb: Options.max_background_flushes: 1
- 2018-04-17 04:35:17.462867 I | rook-ceph-mon0: 2018-04-17 04:35:17.460567 7f383871cf00 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2018-04-17 04:35:17.462886 I | rook-ceph-mon0: 2018-04-17 04:35:17.460570 7f383871cf00 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2018-04-17 04:35:17.462903 I | rook-ceph-mon0: 2018-04-17 04:35:17.460573 7f383871cf00 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2018-04-17 04:35:17.462922 I | rook-ceph-mon0: 2018-04-17 04:35:17.460576 7f383871cf00 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2018-04-17 04:35:17.462942 I | rook-ceph-mon0: 2018-04-17 04:35:17.460578 7f383871cf00 4 rocksdb: Options.advise_random_on_open: 1
- 2018-04-17 04:35:17.462963 I | rook-ceph-mon0: 2018-04-17 04:35:17.460581 7f383871cf00 4 rocksdb: Options.db_write_buffer_size: 0
- 2018-04-17 04:35:17.462982 I | rook-ceph-mon0: 2018-04-17 04:35:17.460583 7f383871cf00 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2018-04-17 04:35:17.463002 I | rook-ceph-mon0: 2018-04-17 04:35:17.460586 7f383871cf00 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2018-04-17 04:35:17.463020 I | rook-ceph-mon0: 2018-04-17 04:35:17.460588 7f383871cf00 4 rocksdb: Options.compaction_readahead_size: 0
- 2018-04-17 04:35:17.463041 I | rook-ceph-mon0: 2018-04-17 04:35:17.460591 7f383871cf00 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2018-04-17 04:35:17.463061 I | rook-ceph-mon0: 2018-04-17 04:35:17.460593 7f383871cf00 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2018-04-17 04:35:17.463080 I | rook-ceph-mon0: 2018-04-17 04:35:17.460596 7f383871cf00 4 rocksdb: Options.use_adaptive_mutex: 0
- 2018-04-17 04:35:17.463098 I | rook-ceph-mon0: 2018-04-17 04:35:17.460598 7f383871cf00 4 rocksdb: Options.rate_limiter: (nil)
- 2018-04-17 04:35:17.463118 I | rook-ceph-mon0: 2018-04-17 04:35:17.460601 7f383871cf00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2018-04-17 04:35:17.463143 I | rook-ceph-mon0: 2018-04-17 04:35:17.460604 7f383871cf00 4 rocksdb: Options.bytes_per_sync: 0
- 2018-04-17 04:35:17.463163 I | rook-ceph-mon0: 2018-04-17 04:35:17.460607 7f383871cf00 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2018-04-17 04:35:17.463184 I | rook-ceph-mon0: 2018-04-17 04:35:17.460609 7f383871cf00 4 rocksdb: Options.wal_recovery_mode: 2
- 2018-04-17 04:35:17.463202 I | rook-ceph-mon0: 2018-04-17 04:35:17.460612 7f383871cf00 4 rocksdb: Options.enable_thread_tracking: 0
- 2018-04-17 04:35:17.463222 I | rook-ceph-mon0: 2018-04-17 04:35:17.460614 7f383871cf00 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2018-04-17 04:35:17.463244 I | rook-ceph-mon0: 2018-04-17 04:35:17.460617 7f383871cf00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2018-04-17 04:35:17.463265 I | rook-ceph-mon0: 2018-04-17 04:35:17.460619 7f383871cf00 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2018-04-17 04:35:17.463284 I | rook-ceph-mon0: 2018-04-17 04:35:17.460622 7f383871cf00 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2018-04-17 04:35:17.463309 I | rook-ceph-mon0: 2018-04-17 04:35:17.460625 7f383871cf00 4 rocksdb: Options.row_cache: None
- 2018-04-17 04:35:17.463330 I | rook-ceph-mon0: 2018-04-17 04:35:17.460627 7f383871cf00 4 rocksdb: Options.wal_filter: None
- 2018-04-17 04:35:17.463351 I | rook-ceph-mon0: 2018-04-17 04:35:17.460630 7f383871cf00 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2018-04-17 04:35:17.463377 I | rook-ceph-mon0: 2018-04-17 04:35:17.460632 7f383871cf00 4 rocksdb: Options.base_background_compactions: 1
- 2018-04-17 04:35:17.463398 I | rook-ceph-mon0: 2018-04-17 04:35:17.460635 7f383871cf00 4 rocksdb: Options.max_background_compactions: 1
- 2018-04-17 04:35:17.463417 I | rook-ceph-mon0: 2018-04-17 04:35:17.460638 7f383871cf00 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2018-04-17 04:35:17.463438 I | rook-ceph-mon0: 2018-04-17 04:35:17.460640 7f383871cf00 4 rocksdb: Options.delayed_write_rate : 16777216
- 2018-04-17 04:35:17.463457 I | rook-ceph-mon0: 2018-04-17 04:35:17.460643 7f383871cf00 4 rocksdb: Options.max_total_wal_size: 0
- 2018-04-17 04:35:17.463595 I | rook-ceph-mon0: 2018-04-17 04:35:17.460646 7f383871cf00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2018-04-17 04:35:17.463649 I | rook-ceph-mon0: 2018-04-17 04:35:17.460649 7f383871cf00 4 rocksdb: Options.stats_dump_period_sec: 600
- 2018-04-17 04:35:17.463670 I | rook-ceph-mon0: 2018-04-17 04:35:17.460651 7f383871cf00 4 rocksdb: Compression algorithms supported:
- 2018-04-17 04:35:17.463689 I | rook-ceph-mon0: 2018-04-17 04:35:17.460654 7f383871cf00 4 rocksdb: Snappy supported: 0
- 2018-04-17 04:35:17.463711 I | rook-ceph-mon0: 2018-04-17 04:35:17.460657 7f383871cf00 4 rocksdb: Zlib supported: 0
- 2018-04-17 04:35:17.464248 I | rook-ceph-mon0: 2018-04-17 04:35:17.460659 7f383871cf00 4 rocksdb: Bzip supported: 0
- 2018-04-17 04:35:17.464294 I | rook-ceph-mon0: 2018-04-17 04:35:17.460662 7f383871cf00 4 rocksdb: LZ4 supported: 0
- 2018-04-17 04:35:17.464323 I | rook-ceph-mon0: 2018-04-17 04:35:17.460664 7f383871cf00 4 rocksdb: ZSTD supported: 0
- 2018-04-17 04:35:17.464352 I | rook-ceph-mon0: 2018-04-17 04:35:17.460667 7f383871cf00 4 rocksdb: Fast CRC32 supported: 0
- 2018-04-17 04:35:17.464476 I | rook-ceph-mon0: 2018-04-17 04:35:17.461456 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-001629
- 2018-04-17 04:35:17.464498 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.464546 I | rook-ceph-mon0: 2018-04-17 04:35:17.461877 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2018-04-17 04:35:17.464564 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.464587 I | rook-ceph-mon0: 2018-04-17 04:35:17.461898 7f383871cf00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2018-04-17 04:35:17.464608 I | rook-ceph-mon0: 2018-04-17 04:35:17.461902 7f383871cf00 4 rocksdb: Options.merge_operator:
- 2018-04-17 04:35:17.464627 I | rook-ceph-mon0: 2018-04-17 04:35:17.461905 7f383871cf00 4 rocksdb: Options.compaction_filter: None
- 2018-04-17 04:35:17.464647 I | rook-ceph-mon0: 2018-04-17 04:35:17.461907 7f383871cf00 4 rocksdb: Options.compaction_filter_factory: None
- 2018-04-17 04:35:17.464666 I | rook-ceph-mon0: 2018-04-17 04:35:17.461910 7f383871cf00 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2018-04-17 04:35:17.464777 I | rook-ceph-mon0: 2018-04-17 04:35:17.461913 7f383871cf00 4 rocksdb: Options.table_factory: BlockBasedTable
- 2018-04-17 04:35:17.464800 I | rook-ceph-mon0: 2018-04-17 04:35:17.461947 7f383871cf00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d390ea60f8)
- 2018-04-17 04:35:17.464821 I | rook-ceph-mon0: cache_index_and_filter_blocks: 1
- 2018-04-17 04:35:17.464947 I | rook-ceph-mon0: cache_index_and_filter_blocks_with_high_priority: 1
- 2018-04-17 04:35:17.464969 I | rook-ceph-mon0: pin_l0_filter_and_index_blocks_in_cache: 1
- 2018-04-17 04:35:17.465017 I | rook-ceph-mon0: index_type: 0
- 2018-04-17 04:35:17.465034 I | rook-ceph-mon0: hash_index_allow_collision: 1
- 2018-04-17 04:35:17.465053 I | rook-ceph-mon0: checksum: 1
- 2018-04-17 04:35:17.465073 I | rook-ceph-mon0: no_block_cache: 0
- 2018-04-17 04:35:17.465098 I | rook-ceph-mon0: block_cache: 0x55d3911b2470
- 2018-04-17 04:35:17.465119 I | rook-ceph-mon0: block_cache_name: LRUCache
- 2018-04-17 04:35:17.465137 I | rook-ceph-mon0: block_cache_options:
- 2018-04-17 04:35:17.465155 I | rook-ceph-mon0: capacity : 134217728
- 2018-04-17 04:35:17.465174 I | rook-ceph-mon0: num_shard_bits : 4
- 2018-04-17 04:35:17.465196 I | rook-ceph-mon0: strict_capacity_limit : 0
- 2018-04-17 04:35:17.465214 I | rook-ceph-mon0: high_pri_pool_ratio: 0.000
- 2018-04-17 04:35:17.465234 I | rook-ceph-mon0: block_cache_compressed: (nil)
- 2018-04-17 04:35:17.465252 I | rook-ceph-mon0: persistent_cache: (nil)
- 2018-04-17 04:35:17.465273 I | rook-ceph-mon0: block_size: 4096
- 2018-04-17 04:35:17.465293 I | rook-ceph-mon0: block_size_deviation: 10
- 2018-04-17 04:35:17.465313 I | rook-ceph-mon0: block_restart_interval: 16
- 2018-04-17 04:35:17.465335 I | rook-ceph-mon0: index_block_restart_interval: 1
- 2018-04-17 04:35:17.465360 I | rook-ceph-mon0: filter_policy: rocksdb.BuiltinBloomFilter
- 2018-04-17 04:35:17.465378 I | rook-ceph-mon0: whole_key_filtering: 1
- 2018-04-17 04:35:17.465396 I | rook-ceph-mon0: format_version: 2
- 2018-04-17 04:35:17.465414 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.465433 I | rook-ceph-mon0: 2018-04-17 04:35:17.461955 7f383871cf00 4 rocksdb: Options.write_buffer_size: 33554432
- 2018-04-17 04:35:17.465452 I | rook-ceph-mon0: 2018-04-17 04:35:17.461958 7f383871cf00 4 rocksdb: Options.max_write_buffer_number: 2
- 2018-04-17 04:35:17.465472 I | rook-ceph-mon0: 2018-04-17 04:35:17.461961 7f383871cf00 4 rocksdb: Options.compression: NoCompression
- 2018-04-17 04:35:17.465496 I | rook-ceph-mon0: 2018-04-17 04:35:17.461966 7f383871cf00 4 rocksdb: Options.bottommost_compression: Disabled
- 2018-04-17 04:35:17.465516 I | rook-ceph-mon0: 2018-04-17 04:35:17.461970 7f383871cf00 4 rocksdb: Options.prefix_extractor: nullptr
- 2018-04-17 04:35:17.465550 I | rook-ceph-mon0: 2018-04-17 04:35:17.461974 7f383871cf00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2018-04-17 04:35:17.465572 I | rook-ceph-mon0: 2018-04-17 04:35:17.461979 7f383871cf00 4 rocksdb: Options.num_levels: 7
- 2018-04-17 04:35:17.465592 I | rook-ceph-mon0: 2018-04-17 04:35:17.461983 7f383871cf00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2018-04-17 04:35:17.465611 I | rook-ceph-mon0: 2018-04-17 04:35:17.461988 7f383871cf00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2018-04-17 04:35:17.465629 I | rook-ceph-mon0: 2018-04-17 04:35:17.461992 7f383871cf00 4 rocksdb: Options.compression_opts.window_bits: -14
- 2018-04-17 04:35:17.465646 I | rook-ceph-mon0: 2018-04-17 04:35:17.461996 7f383871cf00 4 rocksdb: Options.compression_opts.level: -1
- 2018-04-17 04:35:17.465666 I | rook-ceph-mon0: 2018-04-17 04:35:17.462001 7f383871cf00 4 rocksdb: Options.compression_opts.strategy: 0
- 2018-04-17 04:35:17.465773 I | rook-ceph-mon0: 2018-04-17 04:35:17.462005 7f383871cf00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2018-04-17 04:35:17.465795 I | rook-ceph-mon0: 2018-04-17 04:35:17.462010 7f383871cf00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2018-04-17 04:35:17.465814 I | rook-ceph-mon0: 2018-04-17 04:35:17.462015 7f383871cf00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2018-04-17 04:35:17.465859 I | rook-ceph-mon0: 2018-04-17 04:35:17.462020 7f383871cf00 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2018-04-17 04:35:17.465881 I | rook-ceph-mon0: 2018-04-17 04:35:17.462025 7f383871cf00 4 rocksdb: Options.target_file_size_base: 67108864
- 2018-04-17 04:35:17.465901 I | rook-ceph-mon0: 2018-04-17 04:35:17.462030 7f383871cf00 4 rocksdb: Options.target_file_size_multiplier: 1
- 2018-04-17 04:35:17.465924 I | rook-ceph-mon0: 2018-04-17 04:35:17.462034 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2018-04-17 04:35:17.465945 I | rook-ceph-mon0: 2018-04-17 04:35:17.462037 7f383871cf00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2018-04-17 04:35:17.465967 I | rook-ceph-mon0: 2018-04-17 04:35:17.462040 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2018-04-17 04:35:17.465988 I | rook-ceph-mon0: 2018-04-17 04:35:17.462046 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2018-04-17 04:35:17.466007 I | rook-ceph-mon0: 2018-04-17 04:35:17.462049 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2018-04-17 04:35:17.466046 I | rook-ceph-mon0: 2018-04-17 04:35:17.462052 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2018-04-17 04:35:17.466143 I | rook-ceph-mon0: 2018-04-17 04:35:17.462054 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2018-04-17 04:35:17.466162 I | rook-ceph-mon0: 2018-04-17 04:35:17.462057 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2018-04-17 04:35:17.466180 I | rook-ceph-mon0: 2018-04-17 04:35:17.462060 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2018-04-17 04:35:17.466233 I | rook-ceph-mon0: 2018-04-17 04:35:17.462062 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2018-04-17 04:35:17.466252 I | rook-ceph-mon0: 2018-04-17 04:35:17.462065 7f383871cf00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2018-04-17 04:35:17.466270 I | rook-ceph-mon0: 2018-04-17 04:35:17.462068 7f383871cf00 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2018-04-17 04:35:17.466296 I | rook-ceph-mon0: 2018-04-17 04:35:17.462071 7f383871cf00 4 rocksdb: Options.arena_block_size: 4194304
- 2018-04-17 04:35:17.466316 I | rook-ceph-mon0: 2018-04-17 04:35:17.462073 7f383871cf00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2018-04-17 04:35:17.466336 I | rook-ceph-mon0: 2018-04-17 04:35:17.462110 7f383871cf00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2018-04-17 04:35:17.466356 I | rook-ceph-mon0: 2018-04-17 04:35:17.462118 7f383871cf00 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2018-04-17 04:35:17.466375 I | rook-ceph-mon0: 2018-04-17 04:35:17.462123 7f383871cf00 4 rocksdb: Options.disable_auto_compactions: 0
- 2018-04-17 04:35:17.466395 I | rook-ceph-mon0: 2018-04-17 04:35:17.462128 7f383871cf00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2018-04-17 04:35:17.466412 I | rook-ceph-mon0: 2018-04-17 04:35:17.462133 7f383871cf00 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2018-04-17 04:35:17.466430 I | rook-ceph-mon0: 2018-04-17 04:35:17.462138 7f383871cf00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2018-04-17 04:35:17.466450 I | rook-ceph-mon0: 2018-04-17 04:35:17.462141 7f383871cf00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2018-04-17 04:35:17.466468 I | rook-ceph-mon0: 2018-04-17 04:35:17.462144 7f383871cf00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2018-04-17 04:35:17.466488 I | rook-ceph-mon0: 2018-04-17 04:35:17.462149 7f383871cf00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2018-04-17 04:35:17.466508 I | rook-ceph-mon0: 2018-04-17 04:35:17.462153 7f383871cf00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2018-04-17 04:35:17.466528 I | rook-ceph-mon0: 2018-04-17 04:35:17.462158 7f383871cf00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2018-04-17 04:35:17.466547 I | rook-ceph-mon0: 2018-04-17 04:35:17.462162 7f383871cf00 4 rocksdb: Options.table_properties_collectors:
- 2018-04-17 04:35:17.466566 I | rook-ceph-mon0: 2018-04-17 04:35:17.462167 7f383871cf00 4 rocksdb: Options.inplace_update_support: 0
- 2018-04-17 04:35:17.466587 I | rook-ceph-mon0: 2018-04-17 04:35:17.462172 7f383871cf00 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2018-04-17 04:35:17.466608 I | rook-ceph-mon0: 2018-04-17 04:35:17.462177 7f383871cf00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2018-04-17 04:35:17.466627 I | rook-ceph-mon0: 2018-04-17 04:35:17.462184 7f383871cf00 4 rocksdb: Options.memtable_huge_page_size: 0
- 2018-04-17 04:35:17.466646 I | rook-ceph-mon0: 2018-04-17 04:35:17.462189 7f383871cf00 4 rocksdb: Options.bloom_locality: 0
- 2018-04-17 04:35:17.466663 I | rook-ceph-mon0: 2018-04-17 04:35:17.462194 7f383871cf00 4 rocksdb: Options.max_successive_merges: 0
- 2018-04-17 04:35:17.466717 I | rook-ceph-mon0: 2018-04-17 04:35:17.462198 7f383871cf00 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2018-04-17 04:35:17.466742 I | rook-ceph-mon0: 2018-04-17 04:35:17.462203 7f383871cf00 4 rocksdb: Options.paranoid_file_checks: 0
- 2018-04-17 04:35:17.466763 I | rook-ceph-mon0: 2018-04-17 04:35:17.462208 7f383871cf00 4 rocksdb: Options.force_consistency_checks: 0
- 2018-04-17 04:35:17.466782 I | rook-ceph-mon0: 2018-04-17 04:35:17.462211 7f383871cf00 4 rocksdb: Options.report_bg_io_stats: 0
- 2018-04-17 04:35:17.468291 I | rook-ceph-mon0: 2018-04-17 04:35:17.468170 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/rook-ceph-mon0/data/store.db/MANIFEST-001629 succeeded,manifest_file_number is 1629, next_file_number is 1631, last_sequence is 500846, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2018-04-17 04:35:17.468396 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.468417 I | rook-ceph-mon0: 2018-04-17 04:35:17.468204 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 1624
- 2018-04-17 04:35:17.468430 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.468590 I | rook-ceph-mon0: 2018-04-17 04:35:17.468417 7f383871cf00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1523939717468403, "job": 1, "event": "recovery_started", "log_files": [1630]}
- 2018-04-17 04:35:17.468611 I | rook-ceph-mon0: 2018-04-17 04:35:17.468446 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/db_impl_open.cc:482] Recovering log #1630 mode 2
- 2018-04-17 04:35:17.471444 I | rook-ceph-mon0: 2018-04-17 04:35:17.471307 7f383871cf00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1523939717471292, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 1631, "file_size": 1067, "table_properties": {"data_size": 116, "index_size": 27, "filter_size": 18, "raw_key_size": 76, "raw_average_key_size": 25, "raw_value_size": 24, "raw_average_value_size": 8, "num_data_blocks": 1, "num_entries": 3, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018-04-17 04:35:17.471484 I | rook-ceph-mon0: 2018-04-17 04:35:17.471360 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/version_set.cc:2395] Creating manifest 1632
- 2018-04-17 04:35:17.471507 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.474132 I | rook-ceph-mon0: 2018-04-17 04:35:17.473879 7f383871cf00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1523939717473872, "job": 1, "event": "recovery_finished"}
- 2018-04-17 04:35:17.477180 I | rook-ceph-mon0: 2018-04-17 04:35:17.477053 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55d3912c2000
- 2018-04-17 04:35:17.479565 I | rook-ceph-mon0: 2018-04-17 04:35:17.479439 7f383871cf00 0 starting mon.rook-ceph-mon0 rank 1 at public addr 10.107.181.203:6790/0 at bind addr 192.168.33.45:6790/0 mon_data /var/lib/rook/rook-ceph-mon0/data fsid d4f1a1ca-b919-4c5b-89f2-1aed3d913a97
- 2018-04-17 04:35:17.479916 I | rook-ceph-mon0: 2018-04-17 04:35:17.479805 7f383871cf00 0 starting mon.rook-ceph-mon0 rank 1 at 10.107.181.203:6790/0 mon_data /var/lib/rook/rook-ceph-mon0/data fsid d4f1a1ca-b919-4c5b-89f2-1aed3d913a97
- 2018-04-17 04:35:17.482202 I | rook-ceph-mon0: 2018-04-17 04:35:17.482095 7f383871cf00 1 mon.rook-ceph-mon0@-1(probing).paxosservice(pgmap 1..2) refresh upgraded, format 0 -> 1
- 2018-04-17 04:35:17.482525 I | rook-ceph-mon0: 2018-04-17 04:35:17.482361 7f383871cf00 0 mon.rook-ceph-mon0@-1(probing).mds e20 print_map
- 2018-04-17 04:35:17.482549 I | rook-ceph-mon0: e20
- 2018-04-17 04:35:17.482563 I | rook-ceph-mon0: enable_multiple, ever_enabled_multiple: 1,1
- 2018-04-17 04:35:17.482575 I | rook-ceph-mon0: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2}
- 2018-04-17 04:35:17.482590 I | rook-ceph-mon0: legacy client fscid: 1
- 2018-04-17 04:35:17.482604 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.482618 I | rook-ceph-mon0: Filesystem 'fsvolume' (1)
- 2018-04-17 04:35:17.482632 I | rook-ceph-mon0: fs_name fsvolume
- 2018-04-17 04:35:17.482644 I | rook-ceph-mon0: epoch 17
- 2018-04-17 04:35:17.482664 I | rook-ceph-mon0: flags c
- 2018-04-17 04:35:17.482708 I | rook-ceph-mon0: created 2018-04-15 20:14:35.621106
- 2018-04-17 04:35:17.482763 I | rook-ceph-mon0: modified 2018-04-15 20:14:35.621109
- 2018-04-17 04:35:17.482775 I | rook-ceph-mon0: tableserver 0
- 2018-04-17 04:35:17.482786 I | rook-ceph-mon0: root 0
- 2018-04-17 04:35:17.482798 I | rook-ceph-mon0: session_timeout 60
- 2018-04-17 04:35:17.482809 I | rook-ceph-mon0: session_autoclose 300
- 2018-04-17 04:35:17.482827 I | rook-ceph-mon0: max_file_size 1099511627776
- 2018-04-17 04:35:17.482839 I | rook-ceph-mon0: last_failure 0
- 2018-04-17 04:35:17.482850 I | rook-ceph-mon0: last_failure_osd_epoch 38
- 2018-04-17 04:35:17.482862 I | rook-ceph-mon0: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2}
- 2018-04-17 04:35:17.482878 I | rook-ceph-mon0: max_mds 1
- 2018-04-17 04:35:17.482890 I | rook-ceph-mon0: in 0
- 2018-04-17 04:35:17.482902 I | rook-ceph-mon0: up {0=4243}
- 2018-04-17 04:35:17.483118 I | rook-ceph-mon0: failed
- 2018-04-17 04:35:17.483142 I | rook-ceph-mon0: damaged
- 2018-04-17 04:35:17.483154 I | rook-ceph-mon0: stopped
- 2018-04-17 04:35:17.483165 I | rook-ceph-mon0: data_pools [2]
- 2018-04-17 04:35:17.483177 I | rook-ceph-mon0: metadata_pool 1
- 2018-04-17 04:35:17.483190 I | rook-ceph-mon0: inline_data disabled
- 2018-04-17 04:35:17.483205 I | rook-ceph-mon0: balancer
- 2018-04-17 04:35:17.483221 I | rook-ceph-mon0: standby_count_wanted 1
- 2018-04-17 04:35:17.483233 I | rook-ceph-mon0: 4243: 192.168.108.189:6800/3866860933 'mlk6nk' mds.0.14 up:active seq 20607
- 2018-04-17 04:35:17.483255 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.483266 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.483280 I | rook-ceph-mon0: Filesystem 'bypfs' (2)
- 2018-04-17 04:35:17.483295 I | rook-ceph-mon0: fs_name bypfs
- 2018-04-17 04:35:17.483313 I | rook-ceph-mon0: epoch 19
- 2018-04-17 04:35:17.483325 I | rook-ceph-mon0: flags c
- 2018-04-17 04:35:17.483340 I | rook-ceph-mon0: created 2018-04-15 20:19:50.402008
- 2018-04-17 04:35:17.483354 I | rook-ceph-mon0: modified 2018-04-15 20:19:50.402010
- 2018-04-17 04:35:17.483366 I | rook-ceph-mon0: tableserver 0
- 2018-04-17 04:35:17.483377 I | rook-ceph-mon0: root 0
- 2018-04-17 04:35:17.483396 I | rook-ceph-mon0: session_timeout 60
- 2018-04-17 04:35:17.483408 I | rook-ceph-mon0: session_autoclose 300
- 2018-04-17 04:35:17.483424 I | rook-ceph-mon0: max_file_size 1099511627776
- 2018-04-17 04:35:17.483442 I | rook-ceph-mon0: last_failure 0
- 2018-04-17 04:35:17.483454 I | rook-ceph-mon0: last_failure_osd_epoch 38
- 2018-04-17 04:35:17.483469 I | rook-ceph-mon0: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2}
- 2018-04-17 04:35:17.483488 I | rook-ceph-mon0: max_mds 1
- 2018-04-17 04:35:17.483500 I | rook-ceph-mon0: in 0
- 2018-04-17 04:35:17.483512 I | rook-ceph-mon0: up {0=4339}
- 2018-04-17 04:35:17.483529 I | rook-ceph-mon0: failed
- 2018-04-17 04:35:17.483541 I | rook-ceph-mon0: damaged
- 2018-04-17 04:35:17.483555 I | rook-ceph-mon0: stopped
- 2018-04-17 04:35:17.483570 I | rook-ceph-mon0: data_pools [4]
- 2018-04-17 04:35:17.483588 I | rook-ceph-mon0: metadata_pool 3
- 2018-04-17 04:35:17.483600 I | rook-ceph-mon0: inline_data disabled
- 2018-04-17 04:35:17.483812 I | rook-ceph-mon0: balancer
- 2018-04-17 04:35:17.483836 I | rook-ceph-mon0: standby_count_wanted 1
- 2018-04-17 04:35:17.483849 I | rook-ceph-mon0: 4339: 192.168.108.137:6800/3657245232 'mzlvk8' mds.0.14 up:active seq 20539
- 2018-04-17 04:35:17.483861 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.483872 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.483889 I | rook-ceph-mon0: Standby daemons:
- 2018-04-17 04:35:17.483900 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.483915 I | rook-ceph-mon0: 28380: 192.168.59.29:6800/1514657449 'm64rcg' mds.-1.0 up:standby seq 2
- 2018-04-17 04:35:17.483927 I | rook-ceph-mon0:
- 2018-04-17 04:35:17.483946 I | rook-ceph-mon0: 2018-04-17 04:35:17.482923 7f383871cf00 0 mon.rook-ceph-mon0@-1(probing).osd e40 crush map has features 2200130813952, adjusting msgr requires
- 2018-04-17 04:35:17.483959 I | rook-ceph-mon0: 2018-04-17 04:35:17.482943 7f383871cf00 0 mon.rook-ceph-mon0@-1(probing).osd e40 crush map has features 2200130813952, adjusting msgr requires
- 2018-04-17 04:35:17.483983 I | rook-ceph-mon0: 2018-04-17 04:35:17.482950 7f383871cf00 0 mon.rook-ceph-mon0@-1(probing).osd e40 crush map has features 720578140510109696, adjusting msgr requires
- 2018-04-17 04:35:17.483995 I | rook-ceph-mon0: 2018-04-17 04:35:17.482955 7f383871cf00 0 mon.rook-ceph-mon0@-1(probing).osd e40 crush map has features 2200130813952, adjusting msgr requires
- 2018-04-17 04:35:17.484008 I | rook-ceph-mon0: 2018-04-16 19:09:35.463621 mds.mzlvk8 mds.0 192.168.108.137:6800/3657245232 10 : cluster [INF] denied reconnect attempt (mds is up:active) from client.14357 192.168.59.0:0/537108771 after 80.675042 (allowed interval 45)
- 2018-04-17 04:35:17.484020 I | rook-ceph-mon0: 2018-04-17 04:35:17.483520 7f383871cf00 1 mon.rook-ceph-mon0@-1(probing).paxosservice(auth 1..35) refresh upgraded, format 0 -> 2
- 2018-04-17 04:35:17.490286 I | rook-ceph-mon0: 2018-04-17 04:35:17.490051 7f383871cf00 0 mon.rook-ceph-mon0@-1(probing) e3 my rank is now 1 (was -1)
- 2018-04-17 04:35:17.495915 I | rook-ceph-mon0: 2018-04-17 04:35:17.495795 7f382bd67700 0 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0).process missed message? skipped from seq 0 to 776240641
- 2018-04-17 04:35:17.496889 I | rook-ceph-mon0: 2018-04-17 04:35:17.495983 7f382fd6f700 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon0 calling monitor election
- 2018-04-17 04:35:27.502839 I | rook-ceph-mon0: 2018-04-17 04:35:27.502668 7f3832574700 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon0 is new leader, mons rook-ceph-mon0,rook-ceph-mon2 in quorum (ranks 1,2)
- 2018-04-17 04:35:27.509878 I | rook-ceph-mon0: 2018-04-17 04:35:27.509761 7f382fd6f700 0 log_channel(cluster) log [DBG] : monmap e3: 3 mons at {rook-ceph-mon0=10.107.181.203:6790/0,rook-ceph-mon1=10.97.51.86:6790/0,rook-ceph-mon2=10.111.191.96:6790/0}
- 2018-04-17 04:35:27.518460 I | rook-ceph-mon0: 2018-04-17 04:35:27.518367 7f382fd6f700 -1 /build/ceph-12.2.4/src/mds/FSMap.cc: In function 'void FSMap::assign_standby_replay(mds_gid_t, fs_cluster_id_t, mds_rank_t)' thread 7f382fd6f700 time 2018-04-17 04:35:27.510001
- 2018-04-17 04:35:27.518495 I | rook-ceph-mon0: /build/ceph-12.2.4/src/mds/FSMap.cc: 876: FAILED assert(mds_roles.at(standby_gid) == FS_CLUSTER_ID_NONE)
- 2018-04-17 04:35:27.518515 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.518550 I | rook-ceph-mon0: ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)
- 2018-04-17 04:35:27.518577 I | rook-ceph-mon0: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x55d387221672]
- 2018-04-17 04:35:27.518597 I | rook-ceph-mon0: 2: (FSMap::assign_standby_replay(mds_gid_t, int, int)+0x457) [0x55d3874b9eb7]
- 2018-04-17 04:35:27.518617 I | rook-ceph-mon0: 3: (MDSMonitor::try_standby_replay(MDSMap::mds_info_t const&, Filesystem const&, MDSMap::mds_info_t const&)+0x222) [0x55d38719bfe2]
- 2018-04-17 04:35:27.518636 I | rook-ceph-mon0: 4: (MDSMonitor::maybe_promote_standby(std::shared_ptr<Filesystem>)+0xc7c) [0x55d3871a004c]
- 2018-04-17 04:35:27.518661 I | rook-ceph-mon0: 5: (MDSMonitor::tick()+0x8ea) [0x55d3871a6c8a]
- 2018-04-17 04:35:27.518726 I | rook-ceph-mon0: 6: (MDSMonitor::on_active()+0x28) [0x55d38719bc88]
- 2018-04-17 04:35:27.518756 I | rook-ceph-mon0: 7: (PaxosService::_active()+0x40a) [0x55d3870fb77a]
- 2018-04-17 04:35:27.518777 I | rook-ceph-mon0: 8: (Context::complete(int)+0x9) [0x55d386fd1629]
- 2018-04-17 04:35:27.518801 I | rook-ceph-mon0: 9: (void finish_contexts<Context>(CephContext*, std::__cxx11::list<Context*, std::allocator<Context*> >&, int)+0x20b) [0x55d386fdb01b]
- 2018-04-17 04:35:27.518828 I | rook-ceph-mon0: 10: (Paxos::finish_round()+0x188) [0x55d3870f3358]
- 2018-04-17 04:35:27.518859 I | rook-ceph-mon0: 11: (Paxos::handle_last(boost::intrusive_ptr<MonOpRequest>)+0xf9d) [0x55d3870f486d]
- 2018-04-17 04:35:27.518880 I | rook-ceph-mon0: 12: (Paxos::dispatch(boost::intrusive_ptr<MonOpRequest>)+0x263) [0x55d3870f51c3]
- 2018-04-17 04:35:27.518903 I | rook-ceph-mon0: 13: (Monitor::dispatch_op(boost::intrusive_ptr<MonOpRequest>)+0xefe) [0x55d386fc72ce]
- 2018-04-17 04:35:27.518928 I | rook-ceph-mon0: 14: (Monitor::_ms_dispatch(Message*)+0x6db) [0x55d386fc7e5b]
- 2018-04-17 04:35:27.518956 I | rook-ceph-mon0: 15: (Monitor::ms_dispatch(Message*)+0x23) [0x55d386ff7d93]
- 2018-04-17 04:35:27.519001 I | rook-ceph-mon0: 16: (DispatchQueue::entry()+0xf4a) [0x55d38752282a]
- 2018-04-17 04:35:27.519022 I | rook-ceph-mon0: 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x55d3872d1a8d]
- 2018-04-17 04:35:27.519041 I | rook-ceph-mon0: 18: (()+0x76ba) [0x7f3837abc6ba]
- 2018-04-17 04:35:27.519059 I | rook-ceph-mon0: 19: (clone()+0x6d) [0x7f38362e641d]
- 2018-04-17 04:35:27.519077 I | rook-ceph-mon0: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- 2018-04-17 04:35:27.519095 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.519119 I | rook-ceph-mon0: --- begin dump of recent events ---
- 2018-04-17 04:35:27.519139 I | rook-ceph-mon0: -744> 2018-04-17 04:35:17.434718 7f383871cf00 5 asok(0x55d390eaf4a0) register_command perfcounters_dump hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519158 I | rook-ceph-mon0: -743> 2018-04-17 04:35:17.434744 7f383871cf00 5 asok(0x55d390eaf4a0) register_command 1 hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519177 I | rook-ceph-mon0: -742> 2018-04-17 04:35:17.434750 7f383871cf00 5 asok(0x55d390eaf4a0) register_command perf dump hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519197 I | rook-ceph-mon0: -741> 2018-04-17 04:35:17.434789 7f383871cf00 5 asok(0x55d390eaf4a0) register_command perfcounters_schema hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519227 I | rook-ceph-mon0: -740> 2018-04-17 04:35:17.434798 7f383871cf00 5 asok(0x55d390eaf4a0) register_command perf histogram dump hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519247 I | rook-ceph-mon0: -739> 2018-04-17 04:35:17.434811 7f383871cf00 5 asok(0x55d390eaf4a0) register_command 2 hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519265 I | rook-ceph-mon0: -738> 2018-04-17 04:35:17.434816 7f383871cf00 5 asok(0x55d390eaf4a0) register_command perf schema hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519284 I | rook-ceph-mon0: -737> 2018-04-17 04:35:17.434821 7f383871cf00 5 asok(0x55d390eaf4a0) register_command perf histogram schema hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519303 I | rook-ceph-mon0: -736> 2018-04-17 04:35:17.434836 7f383871cf00 5 asok(0x55d390eaf4a0) register_command perf reset hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519324 I | rook-ceph-mon0: -735> 2018-04-17 04:35:17.434841 7f383871cf00 5 asok(0x55d390eaf4a0) register_command config show hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519344 I | rook-ceph-mon0: -734> 2018-04-17 04:35:17.434846 7f383871cf00 5 asok(0x55d390eaf4a0) register_command config help hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519362 I | rook-ceph-mon0: -733> 2018-04-17 04:35:17.434859 7f383871cf00 5 asok(0x55d390eaf4a0) register_command config set hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519381 I | rook-ceph-mon0: -732> 2018-04-17 04:35:17.434864 7f383871cf00 5 asok(0x55d390eaf4a0) register_command config get hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519400 I | rook-ceph-mon0: -731> 2018-04-17 04:35:17.434870 7f383871cf00 5 asok(0x55d390eaf4a0) register_command config diff hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519419 I | rook-ceph-mon0: -730> 2018-04-17 04:35:17.434884 7f383871cf00 5 asok(0x55d390eaf4a0) register_command config diff get hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519455 I | rook-ceph-mon0: -729> 2018-04-17 04:35:17.434889 7f383871cf00 5 asok(0x55d390eaf4a0) register_command log flush hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519478 I | rook-ceph-mon0: -728> 2018-04-17 04:35:17.434894 7f383871cf00 5 asok(0x55d390eaf4a0) register_command log dump hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519497 I | rook-ceph-mon0: -727> 2018-04-17 04:35:17.434908 7f383871cf00 5 asok(0x55d390eaf4a0) register_command log reopen hook 0x55d390eaa1a0
- 2018-04-17 04:35:27.519515 I | rook-ceph-mon0: -726> 2018-04-17 04:35:17.434917 7f383871cf00 5 asok(0x55d390eaf4a0) register_command dump_mempools hook 0x55d391180d48
- 2018-04-17 04:35:27.519535 I | rook-ceph-mon0: -725> 2018-04-17 04:35:17.446196 7f383871cf00 0 ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable), process (unknown), pid 18
- 2018-04-17 04:35:27.519557 I | rook-ceph-mon0: -724> 2018-04-17 04:35:17.446341 7f383871cf00 0 pidfile_write: ignore empty --pid-file
- 2018-04-17 04:35:27.519577 I | rook-ceph-mon0: -723> 2018-04-17 04:35:17.449774 7f383871cf00 5 asok(0x55d390eaf4a0) init /var/lib/rook/rook-ceph-mon0/rook-mon.rook-ceph-mon0.asok
- 2018-04-17 04:35:27.519596 I | rook-ceph-mon0: -722> 2018-04-17 04:35:17.449821 7f383871cf00 5 asok(0x55d390eaf4a0) bind_and_listen /var/lib/rook/rook-ceph-mon0/rook-mon.rook-ceph-mon0.asok
- 2018-04-17 04:35:27.519615 I | rook-ceph-mon0: -721> 2018-04-17 04:35:17.450062 7f383871cf00 5 asok(0x55d390eaf4a0) register_command 0 hook 0x55d390ea60f0
- 2018-04-17 04:35:27.519635 I | rook-ceph-mon0: -720> 2018-04-17 04:35:17.450082 7f383871cf00 5 asok(0x55d390eaf4a0) register_command version hook 0x55d390ea60f0
- 2018-04-17 04:35:27.519654 I | rook-ceph-mon0: -719> 2018-04-17 04:35:17.450088 7f383871cf00 5 asok(0x55d390eaf4a0) register_command git_version hook 0x55d390ea60f0
- 2018-04-17 04:35:27.519672 I | rook-ceph-mon0: -718> 2018-04-17 04:35:17.450095 7f383871cf00 5 asok(0x55d390eaf4a0) register_command help hook 0x55d390eaa270
- 2018-04-17 04:35:27.519832 I | rook-ceph-mon0: -717> 2018-04-17 04:35:17.450102 7f383871cf00 5 asok(0x55d390eaf4a0) register_command get_command_descriptions hook 0x55d390eaa280
- 2018-04-17 04:35:27.519851 I | rook-ceph-mon0: -716> 2018-04-17 04:35:17.450307 7f3833dc3700 5 asok(0x55d390eaf4a0) entry start
- 2018-04-17 04:35:27.519869 I | rook-ceph-mon0: -715> 2018-04-17 04:35:17.459828 7f383871cf00 0 load: jerasure load: lrc load: isa
- 2018-04-17 04:35:27.519888 I | rook-ceph-mon0: -714> 2018-04-17 04:35:17.460025 7f383871cf00 0 set rocksdb option compression = kNoCompression
- 2018-04-17 04:35:27.519906 I | rook-ceph-mon0: -713> 2018-04-17 04:35:17.460052 7f383871cf00 0 set rocksdb option write_buffer_size = 33554432
- 2018-04-17 04:35:27.519925 I | rook-ceph-mon0: -712> 2018-04-17 04:35:17.460077 7f383871cf00 0 set rocksdb option compression = kNoCompression
- 2018-04-17 04:35:27.519943 I | rook-ceph-mon0: -711> 2018-04-17 04:35:17.460085 7f383871cf00 0 set rocksdb option write_buffer_size = 33554432
- 2018-04-17 04:35:27.519962 I | rook-ceph-mon0: -710> 2018-04-17 04:35:17.460312 7f383871cf00 4 rocksdb: RocksDB version: 5.4.0
- 2018-04-17 04:35:27.520004 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.520024 I | rook-ceph-mon0: -709> 2018-04-17 04:35:17.460338 7f383871cf00 4 rocksdb: Git sha rocksdb_build_git_sha:@0@
- 2018-04-17 04:35:27.520042 I | rook-ceph-mon0: -708> 2018-04-17 04:35:17.460343 7f383871cf00 4 rocksdb: Compile date Feb 26 2018
- 2018-04-17 04:35:27.520061 I | rook-ceph-mon0: -707> 2018-04-17 04:35:17.460346 7f383871cf00 4 rocksdb: DB SUMMARY
- 2018-04-17 04:35:27.520079 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.520097 I | rook-ceph-mon0: -706> 2018-04-17 04:35:17.460435 7f383871cf00 4 rocksdb: CURRENT file: CURRENT
- 2018-04-17 04:35:27.520116 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.520134 I | rook-ceph-mon0: -705> 2018-04-17 04:35:17.460441 7f383871cf00 4 rocksdb: IDENTITY file: IDENTITY
- 2018-04-17 04:35:27.520152 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.520180 I | rook-ceph-mon0: -704> 2018-04-17 04:35:17.460459 7f383871cf00 4 rocksdb: MANIFEST file: MANIFEST-001629 size: 183 Bytes
- 2018-04-17 04:35:27.520198 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.520217 I | rook-ceph-mon0: -703> 2018-04-17 04:35:17.460464 7f383871cf00 4 rocksdb: SST files in /var/lib/rook/rook-ceph-mon0/data/store.db dir, Total Num: 2, files: 001626.sst 001628.sst
- 2018-04-17 04:35:27.520235 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.520254 I | rook-ceph-mon0: -702> 2018-04-17 04:35:17.460469 7f383871cf00 4 rocksdb: Write Ahead Log file in /var/lib/rook/rook-ceph-mon0/data/store.db: 001630.log size: 449 ;
- 2018-04-17 04:35:27.520273 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.520291 I | rook-ceph-mon0: -701> 2018-04-17 04:35:17.460472 7f383871cf00 4 rocksdb: Options.error_if_exists: 0
- 2018-04-17 04:35:27.520313 I | rook-ceph-mon0: -700> 2018-04-17 04:35:17.460475 7f383871cf00 4 rocksdb: Options.create_if_missing: 0
- 2018-04-17 04:35:27.520336 I | rook-ceph-mon0: -699> 2018-04-17 04:35:17.460478 7f383871cf00 4 rocksdb: Options.paranoid_checks: 1
- 2018-04-17 04:35:27.520354 I | rook-ceph-mon0: -698> 2018-04-17 04:35:17.460481 7f383871cf00 4 rocksdb: Options.env: 0x55d38fe0ef20
- 2018-04-17 04:35:27.520377 I | rook-ceph-mon0: -697> 2018-04-17 04:35:17.460484 7f383871cf00 4 rocksdb: Options.info_log: 0x55d3911c67c0
- 2018-04-17 04:35:27.520392 I | rook-ceph-mon0: -696> 2018-04-17 04:35:17.460486 7f383871cf00 4 rocksdb: Options.max_open_files: -1
- 2018-04-17 04:35:27.520403 I | rook-ceph-mon0: -695> 2018-04-17 04:35:17.460490 7f383871cf00 4 rocksdb: Options.max_file_opening_threads: 16
- 2018-04-17 04:35:27.520415 I | rook-ceph-mon0: -694> 2018-04-17 04:35:17.460492 7f383871cf00 4 rocksdb: Options.use_fsync: 0
- 2018-04-17 04:35:27.520427 I | rook-ceph-mon0: -693> 2018-04-17 04:35:17.460495 7f383871cf00 4 rocksdb: Options.max_log_file_size: 0
- 2018-04-17 04:35:27.520442 I | rook-ceph-mon0: -692> 2018-04-17 04:35:17.460498 7f383871cf00 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
- 2018-04-17 04:35:27.520455 I | rook-ceph-mon0: -691> 2018-04-17 04:35:17.460501 7f383871cf00 4 rocksdb: Options.log_file_time_to_roll: 0
- 2018-04-17 04:35:27.520467 I | rook-ceph-mon0: -690> 2018-04-17 04:35:17.460504 7f383871cf00 4 rocksdb: Options.keep_log_file_num: 1000
- 2018-04-17 04:35:27.520479 I | rook-ceph-mon0: -689> 2018-04-17 04:35:17.460506 7f383871cf00 4 rocksdb: Options.recycle_log_file_num: 0
- 2018-04-17 04:35:27.520490 I | rook-ceph-mon0: -688> 2018-04-17 04:35:17.460509 7f383871cf00 4 rocksdb: Options.allow_fallocate: 1
- 2018-04-17 04:35:27.520502 I | rook-ceph-mon0: -687> 2018-04-17 04:35:17.460538 7f383871cf00 4 rocksdb: Options.allow_mmap_reads: 0
- 2018-04-17 04:35:27.520516 I | rook-ceph-mon0: -686> 2018-04-17 04:35:17.460543 7f383871cf00 4 rocksdb: Options.allow_mmap_writes: 0
- 2018-04-17 04:35:27.520529 I | rook-ceph-mon0: -685> 2018-04-17 04:35:17.460545 7f383871cf00 4 rocksdb: Options.use_direct_reads: 0
- 2018-04-17 04:35:27.520541 I | rook-ceph-mon0: -684> 2018-04-17 04:35:17.460548 7f383871cf00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
- 2018-04-17 04:35:27.520553 I | rook-ceph-mon0: -683> 2018-04-17 04:35:17.460551 7f383871cf00 4 rocksdb: Options.create_missing_column_families: 0
- 2018-04-17 04:35:27.520565 I | rook-ceph-mon0: -682> 2018-04-17 04:35:17.460553 7f383871cf00 4 rocksdb: Options.db_log_dir:
- 2018-04-17 04:35:27.520577 I | rook-ceph-mon0: -681> 2018-04-17 04:35:17.460556 7f383871cf00 4 rocksdb: Options.wal_dir: /var/lib/rook/rook-ceph-mon0/data/store.db
- 2018-04-17 04:35:27.520588 I | rook-ceph-mon0: -680> 2018-04-17 04:35:17.460559 7f383871cf00 4 rocksdb: Options.table_cache_numshardbits: 6
- 2018-04-17 04:35:27.520600 I | rook-ceph-mon0: -679> 2018-04-17 04:35:17.460562 7f383871cf00 4 rocksdb: Options.max_subcompactions: 1
- 2018-04-17 04:35:27.520612 I | rook-ceph-mon0: -678> 2018-04-17 04:35:17.460565 7f383871cf00 4 rocksdb: Options.max_background_flushes: 1
- 2018-04-17 04:35:27.520624 I | rook-ceph-mon0: -677> 2018-04-17 04:35:17.460567 7f383871cf00 4 rocksdb: Options.WAL_ttl_seconds: 0
- 2018-04-17 04:35:27.520635 I | rook-ceph-mon0: -676> 2018-04-17 04:35:17.460570 7f383871cf00 4 rocksdb: Options.WAL_size_limit_MB: 0
- 2018-04-17 04:35:27.520650 I | rook-ceph-mon0: -675> 2018-04-17 04:35:17.460573 7f383871cf00 4 rocksdb: Options.manifest_preallocation_size: 4194304
- 2018-04-17 04:35:27.520661 I | rook-ceph-mon0: -674> 2018-04-17 04:35:17.460576 7f383871cf00 4 rocksdb: Options.is_fd_close_on_exec: 1
- 2018-04-17 04:35:27.520673 I | rook-ceph-mon0: -673> 2018-04-17 04:35:17.460578 7f383871cf00 4 rocksdb: Options.advise_random_on_open: 1
- 2018-04-17 04:35:27.520709 I | rook-ceph-mon0: -672> 2018-04-17 04:35:17.460581 7f383871cf00 4 rocksdb: Options.db_write_buffer_size: 0
- 2018-04-17 04:35:27.520721 I | rook-ceph-mon0: -671> 2018-04-17 04:35:17.460583 7f383871cf00 4 rocksdb: Options.access_hint_on_compaction_start: 1
- 2018-04-17 04:35:27.520742 I | rook-ceph-mon0: -670> 2018-04-17 04:35:17.460586 7f383871cf00 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0
- 2018-04-17 04:35:27.520756 I | rook-ceph-mon0: -669> 2018-04-17 04:35:17.460588 7f383871cf00 4 rocksdb: Options.compaction_readahead_size: 0
- 2018-04-17 04:35:27.520771 I | rook-ceph-mon0: -668> 2018-04-17 04:35:17.460591 7f383871cf00 4 rocksdb: Options.random_access_max_buffer_size: 1048576
- 2018-04-17 04:35:27.520783 I | rook-ceph-mon0: -667> 2018-04-17 04:35:17.460593 7f383871cf00 4 rocksdb: Options.writable_file_max_buffer_size: 1048576
- 2018-04-17 04:35:27.520795 I | rook-ceph-mon0: -666> 2018-04-17 04:35:17.460596 7f383871cf00 4 rocksdb: Options.use_adaptive_mutex: 0
- 2018-04-17 04:35:27.520806 I | rook-ceph-mon0: -665> 2018-04-17 04:35:17.460598 7f383871cf00 4 rocksdb: Options.rate_limiter: (nil)
- 2018-04-17 04:35:27.520817 I | rook-ceph-mon0: -664> 2018-04-17 04:35:17.460601 7f383871cf00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
- 2018-04-17 04:35:27.520829 I | rook-ceph-mon0: -663> 2018-04-17 04:35:17.460604 7f383871cf00 4 rocksdb: Options.bytes_per_sync: 0
- 2018-04-17 04:35:27.520841 I | rook-ceph-mon0: -662> 2018-04-17 04:35:17.460607 7f383871cf00 4 rocksdb: Options.wal_bytes_per_sync: 0
- 2018-04-17 04:35:27.520853 I | rook-ceph-mon0: -661> 2018-04-17 04:35:17.460609 7f383871cf00 4 rocksdb: Options.wal_recovery_mode: 2
- 2018-04-17 04:35:27.520864 I | rook-ceph-mon0: -660> 2018-04-17 04:35:17.460612 7f383871cf00 4 rocksdb: Options.enable_thread_tracking: 0
- 2018-04-17 04:35:27.520876 I | rook-ceph-mon0: -659> 2018-04-17 04:35:17.460614 7f383871cf00 4 rocksdb: Options.allow_concurrent_memtable_write: 1
- 2018-04-17 04:35:27.520888 I | rook-ceph-mon0: -658> 2018-04-17 04:35:17.460617 7f383871cf00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
- 2018-04-17 04:35:27.520899 I | rook-ceph-mon0: -657> 2018-04-17 04:35:17.460619 7f383871cf00 4 rocksdb: Options.write_thread_max_yield_usec: 100
- 2018-04-17 04:35:27.520913 I | rook-ceph-mon0: -656> 2018-04-17 04:35:17.460622 7f383871cf00 4 rocksdb: Options.write_thread_slow_yield_usec: 3
- 2018-04-17 04:35:27.520925 I | rook-ceph-mon0: -655> 2018-04-17 04:35:17.460625 7f383871cf00 4 rocksdb: Options.row_cache: None
- 2018-04-17 04:35:27.520937 I | rook-ceph-mon0: -654> 2018-04-17 04:35:17.460627 7f383871cf00 4 rocksdb: Options.wal_filter: None
- 2018-04-17 04:35:27.520948 I | rook-ceph-mon0: -653> 2018-04-17 04:35:17.460630 7f383871cf00 4 rocksdb: Options.avoid_flush_during_recovery: 0
- 2018-04-17 04:35:27.520978 I | rook-ceph-mon0: -652> 2018-04-17 04:35:17.460632 7f383871cf00 4 rocksdb: Options.base_background_compactions: 1
- 2018-04-17 04:35:27.520999 I | rook-ceph-mon0: -651> 2018-04-17 04:35:17.460635 7f383871cf00 4 rocksdb: Options.max_background_compactions: 1
- 2018-04-17 04:35:27.521021 I | rook-ceph-mon0: -650> 2018-04-17 04:35:17.460638 7f383871cf00 4 rocksdb: Options.avoid_flush_during_shutdown: 0
- 2018-04-17 04:35:27.521040 I | rook-ceph-mon0: -649> 2018-04-17 04:35:17.460640 7f383871cf00 4 rocksdb: Options.delayed_write_rate : 16777216
- 2018-04-17 04:35:27.521052 I | rook-ceph-mon0: -648> 2018-04-17 04:35:17.460643 7f383871cf00 4 rocksdb: Options.max_total_wal_size: 0
- 2018-04-17 04:35:27.521064 I | rook-ceph-mon0: -647> 2018-04-17 04:35:17.460646 7f383871cf00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
- 2018-04-17 04:35:27.521075 I | rook-ceph-mon0: -646> 2018-04-17 04:35:17.460649 7f383871cf00 4 rocksdb: Options.stats_dump_period_sec: 600
- 2018-04-17 04:35:27.521087 I | rook-ceph-mon0: -645> 2018-04-17 04:35:17.460651 7f383871cf00 4 rocksdb: Compression algorithms supported:
- 2018-04-17 04:35:27.521099 I | rook-ceph-mon0: -644> 2018-04-17 04:35:17.460654 7f383871cf00 4 rocksdb: Snappy supported: 0
- 2018-04-17 04:35:27.521111 I | rook-ceph-mon0: -643> 2018-04-17 04:35:17.460657 7f383871cf00 4 rocksdb: Zlib supported: 0
- 2018-04-17 04:35:27.521123 I | rook-ceph-mon0: -642> 2018-04-17 04:35:17.460659 7f383871cf00 4 rocksdb: Bzip supported: 0
- 2018-04-17 04:35:27.521134 I | rook-ceph-mon0: -641> 2018-04-17 04:35:17.460662 7f383871cf00 4 rocksdb: LZ4 supported: 0
- 2018-04-17 04:35:27.521145 I | rook-ceph-mon0: -640> 2018-04-17 04:35:17.460664 7f383871cf00 4 rocksdb: ZSTD supported: 0
- 2018-04-17 04:35:27.521157 I | rook-ceph-mon0: -639> 2018-04-17 04:35:17.460667 7f383871cf00 4 rocksdb: Fast CRC32 supported: 0
- 2018-04-17 04:35:27.521169 I | rook-ceph-mon0: -638> 2018-04-17 04:35:17.461456 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-001629
- 2018-04-17 04:35:27.521180 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.521191 I | rook-ceph-mon0: -637> 2018-04-17 04:35:17.461877 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
- 2018-04-17 04:35:27.521203 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.521214 I | rook-ceph-mon0: -636> 2018-04-17 04:35:17.461898 7f383871cf00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
- 2018-04-17 04:35:27.521226 I | rook-ceph-mon0: -635> 2018-04-17 04:35:17.461902 7f383871cf00 4 rocksdb: Options.merge_operator:
- 2018-04-17 04:35:27.521237 I | rook-ceph-mon0: -634> 2018-04-17 04:35:17.461905 7f383871cf00 4 rocksdb: Options.compaction_filter: None
- 2018-04-17 04:35:27.521256 I | rook-ceph-mon0: -633> 2018-04-17 04:35:17.461907 7f383871cf00 4 rocksdb: Options.compaction_filter_factory: None
- 2018-04-17 04:35:27.521268 I | rook-ceph-mon0: -632> 2018-04-17 04:35:17.461910 7f383871cf00 4 rocksdb: Options.memtable_factory: SkipListFactory
- 2018-04-17 04:35:27.521280 I | rook-ceph-mon0: -631> 2018-04-17 04:35:17.461913 7f383871cf00 4 rocksdb: Options.table_factory: BlockBasedTable
- 2018-04-17 04:35:27.521291 I | rook-ceph-mon0: -630> 2018-04-17 04:35:17.461947 7f383871cf00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d390ea60f8)
- 2018-04-17 04:35:27.521303 I | rook-ceph-mon0: cache_index_and_filter_blocks: 1
- 2018-04-17 04:35:27.521314 I | rook-ceph-mon0: cache_index_and_filter_blocks_with_high_priority: 1
- 2018-04-17 04:35:27.521326 I | rook-ceph-mon0: pin_l0_filter_and_index_blocks_in_cache: 1
- 2018-04-17 04:35:27.521358 I | rook-ceph-mon0: index_type: 0
- 2018-04-17 04:35:27.521377 I | rook-ceph-mon0: hash_index_allow_collision: 1
- 2018-04-17 04:35:27.521396 I | rook-ceph-mon0: checksum: 1
- 2018-04-17 04:35:27.521410 I | rook-ceph-mon0: no_block_cache: 0
- 2018-04-17 04:35:27.521421 I | rook-ceph-mon0: block_cache: 0x55d3911b2470
- 2018-04-17 04:35:27.521435 I | rook-ceph-mon0: block_cache_name: LRUCache
- 2018-04-17 04:35:27.521446 I | rook-ceph-mon0: block_cache_options:
- 2018-04-17 04:35:27.521458 I | rook-ceph-mon0: capacity : 134217728
- 2018-04-17 04:35:27.521469 I | rook-ceph-mon0: num_shard_bits : 4
- 2018-04-17 04:35:27.521480 I | rook-ceph-mon0: strict_capacity_limit : 0
- 2018-04-17 04:35:27.521492 I | rook-ceph-mon0: high_pri_pool_ratio: 0.000
- 2018-04-17 04:35:27.521503 I | rook-ceph-mon0: block_cache_compressed: (nil)
- 2018-04-17 04:35:27.521514 I | rook-ceph-mon0: persistent_cache: (nil)
- 2018-04-17 04:35:27.521526 I | rook-ceph-mon0: block_size: 4096
- 2018-04-17 04:35:27.521537 I | rook-ceph-mon0: block_size_deviation: 10
- 2018-04-17 04:35:27.521548 I | rook-ceph-mon0: block_restart_interval: 16
- 2018-04-17 04:35:27.521560 I | rook-ceph-mon0: index_block_restart_interval: 1
- 2018-04-17 04:35:27.521571 I | rook-ceph-mon0: filter_policy: rocksdb.BuiltinBloomFilter
- 2018-04-17 04:35:27.521582 I | rook-ceph-mon0: whole_key_filtering: 1
- 2018-04-17 04:35:27.521594 I | rook-ceph-mon0: format_version: 2
- 2018-04-17 04:35:27.521605 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.521616 I | rook-ceph-mon0: -629> 2018-04-17 04:35:17.461955 7f383871cf00 4 rocksdb: Options.write_buffer_size: 33554432
- 2018-04-17 04:35:27.521628 I | rook-ceph-mon0: -628> 2018-04-17 04:35:17.461958 7f383871cf00 4 rocksdb: Options.max_write_buffer_number: 2
- 2018-04-17 04:35:27.521640 I | rook-ceph-mon0: -627> 2018-04-17 04:35:17.461961 7f383871cf00 4 rocksdb: Options.compression: NoCompression
- 2018-04-17 04:35:27.521651 I | rook-ceph-mon0: -626> 2018-04-17 04:35:17.461966 7f383871cf00 4 rocksdb: Options.bottommost_compression: Disabled
- 2018-04-17 04:35:27.521663 I | rook-ceph-mon0: -625> 2018-04-17 04:35:17.461970 7f383871cf00 4 rocksdb: Options.prefix_extractor: nullptr
- 2018-04-17 04:35:27.521675 I | rook-ceph-mon0: -624> 2018-04-17 04:35:17.461974 7f383871cf00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2018-04-17 04:35:27.521720 I | rook-ceph-mon0: -623> 2018-04-17 04:35:17.461979 7f383871cf00 4 rocksdb: Options.num_levels: 7
- 2018-04-17 04:35:27.521739 I | rook-ceph-mon0: -622> 2018-04-17 04:35:17.461983 7f383871cf00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
- 2018-04-17 04:35:27.521752 I | rook-ceph-mon0: -621> 2018-04-17 04:35:17.461988 7f383871cf00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
- 2018-04-17 04:35:27.521764 I | rook-ceph-mon0: -620> 2018-04-17 04:35:17.461992 7f383871cf00 4 rocksdb: Options.compression_opts.window_bits: -14
- 2018-04-17 04:35:27.521775 I | rook-ceph-mon0: -619> 2018-04-17 04:35:17.461996 7f383871cf00 4 rocksdb: Options.compression_opts.level: -1
- 2018-04-17 04:35:27.521786 I | rook-ceph-mon0: -618> 2018-04-17 04:35:17.462001 7f383871cf00 4 rocksdb: Options.compression_opts.strategy: 0
- 2018-04-17 04:35:27.521798 I | rook-ceph-mon0: -617> 2018-04-17 04:35:17.462005 7f383871cf00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
- 2018-04-17 04:35:27.521810 I | rook-ceph-mon0: -616> 2018-04-17 04:35:17.462010 7f383871cf00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
- 2018-04-17 04:35:27.521822 I | rook-ceph-mon0: -615> 2018-04-17 04:35:17.462015 7f383871cf00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
- 2018-04-17 04:35:27.521833 I | rook-ceph-mon0: -614> 2018-04-17 04:35:17.462020 7f383871cf00 4 rocksdb: Options.level0_stop_writes_trigger: 36
- 2018-04-17 04:35:27.521844 I | rook-ceph-mon0: -613> 2018-04-17 04:35:17.462025 7f383871cf00 4 rocksdb: Options.target_file_size_base: 67108864
- 2018-04-17 04:35:27.521860 I | rook-ceph-mon0: -612> 2018-04-17 04:35:17.462030 7f383871cf00 4 rocksdb: Options.target_file_size_multiplier: 1
- 2018-04-17 04:35:27.521873 I | rook-ceph-mon0: -611> 2018-04-17 04:35:17.462034 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_base: 268435456
- 2018-04-17 04:35:27.521887 I | rook-ceph-mon0: -610> 2018-04-17 04:35:17.462037 7f383871cf00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
- 2018-04-17 04:35:27.521898 I | rook-ceph-mon0: -609> 2018-04-17 04:35:17.462040 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
- 2018-04-17 04:35:27.521910 I | rook-ceph-mon0: -608> 2018-04-17 04:35:17.462046 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2018-04-17 04:35:27.521922 I | rook-ceph-mon0: -607> 2018-04-17 04:35:17.462049 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2018-04-17 04:35:27.521933 I | rook-ceph-mon0: -606> 2018-04-17 04:35:17.462052 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2018-04-17 04:35:27.521945 I | rook-ceph-mon0: -605> 2018-04-17 04:35:17.462054 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2018-04-17 04:35:27.521956 I | rook-ceph-mon0: -604> 2018-04-17 04:35:17.462057 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2018-04-17 04:35:27.521983 I | rook-ceph-mon0: -603> 2018-04-17 04:35:17.462060 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2018-04-17 04:35:27.521996 I | rook-ceph-mon0: -602> 2018-04-17 04:35:17.462062 7f383871cf00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2018-04-17 04:35:27.522007 I | rook-ceph-mon0: -601> 2018-04-17 04:35:17.462065 7f383871cf00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
- 2018-04-17 04:35:27.522018 I | rook-ceph-mon0: -600> 2018-04-17 04:35:17.462068 7f383871cf00 4 rocksdb: Options.max_compaction_bytes: 1677721600
- 2018-04-17 04:35:27.522030 I | rook-ceph-mon0: -599> 2018-04-17 04:35:17.462071 7f383871cf00 4 rocksdb: Options.arena_block_size: 4194304
- 2018-04-17 04:35:27.522041 I | rook-ceph-mon0: -598> 2018-04-17 04:35:17.462073 7f383871cf00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
- 2018-04-17 04:35:27.522052 I | rook-ceph-mon0: -597> 2018-04-17 04:35:17.462110 7f383871cf00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
- 2018-04-17 04:35:27.522063 I | rook-ceph-mon0: -596> 2018-04-17 04:35:17.462118 7f383871cf00 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
- 2018-04-17 04:35:27.522074 I | rook-ceph-mon0: -595> 2018-04-17 04:35:17.462123 7f383871cf00 4 rocksdb: Options.disable_auto_compactions: 0
- 2018-04-17 04:35:27.522086 I | rook-ceph-mon0: -594> 2018-04-17 04:35:17.462128 7f383871cf00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
- 2018-04-17 04:35:27.522098 I | rook-ceph-mon0: -593> 2018-04-17 04:35:17.462133 7f383871cf00 4 rocksdb: Options.compaction_pri: kByCompensatedSize
- 2018-04-17 04:35:27.522109 I | rook-ceph-mon0: -592> 2018-04-17 04:35:17.462138 7f383871cf00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
- 2018-04-17 04:35:27.522121 I | rook-ceph-mon0: -591> 2018-04-17 04:35:17.462141 7f383871cf00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
- 2018-04-17 04:35:27.522132 I | rook-ceph-mon0: -590> 2018-04-17 04:35:17.462144 7f383871cf00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
- 2018-04-17 04:35:27.522143 I | rook-ceph-mon0: -589> 2018-04-17 04:35:17.462149 7f383871cf00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
- 2018-04-17 04:35:27.522155 I | rook-ceph-mon0: -588> 2018-04-17 04:35:17.462153 7f383871cf00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
- 2018-04-17 04:35:27.522167 I | rook-ceph-mon0: -587> 2018-04-17 04:35:17.462158 7f383871cf00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2018-04-17 04:35:27.522183 I | rook-ceph-mon0: -586> 2018-04-17 04:35:17.462162 7f383871cf00 4 rocksdb: Options.table_properties_collectors:
- 2018-04-17 04:35:27.522196 I | rook-ceph-mon0: -585> 2018-04-17 04:35:17.462167 7f383871cf00 4 rocksdb: Options.inplace_update_support: 0
- 2018-04-17 04:35:27.522208 I | rook-ceph-mon0: -584> 2018-04-17 04:35:17.462172 7f383871cf00 4 rocksdb: Options.inplace_update_num_locks: 10000
- 2018-04-17 04:35:27.522219 I | rook-ceph-mon0: -583> 2018-04-17 04:35:17.462177 7f383871cf00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2018-04-17 04:35:27.522231 I | rook-ceph-mon0: -582> 2018-04-17 04:35:17.462184 7f383871cf00 4 rocksdb: Options.memtable_huge_page_size: 0
- 2018-04-17 04:35:27.522243 I | rook-ceph-mon0: -581> 2018-04-17 04:35:17.462189 7f383871cf00 4 rocksdb: Options.bloom_locality: 0
- 2018-04-17 04:35:27.522254 I | rook-ceph-mon0: -580> 2018-04-17 04:35:17.462194 7f383871cf00 4 rocksdb: Options.max_successive_merges: 0
- 2018-04-17 04:35:27.522266 I | rook-ceph-mon0: -579> 2018-04-17 04:35:17.462198 7f383871cf00 4 rocksdb: Options.optimize_filters_for_hits: 0
- 2018-04-17 04:35:27.522277 I | rook-ceph-mon0: -578> 2018-04-17 04:35:17.462203 7f383871cf00 4 rocksdb: Options.paranoid_file_checks: 0
- 2018-04-17 04:35:27.522289 I | rook-ceph-mon0: -577> 2018-04-17 04:35:17.462208 7f383871cf00 4 rocksdb: Options.force_consistency_checks: 0
- 2018-04-17 04:35:27.522300 I | rook-ceph-mon0: -576> 2018-04-17 04:35:17.462211 7f383871cf00 4 rocksdb: Options.report_bg_io_stats: 0
- 2018-04-17 04:35:27.522312 I | rook-ceph-mon0: -575> 2018-04-17 04:35:17.468170 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:/var/lib/rook/rook-ceph-mon0/data/store.db/MANIFEST-001629 succeeded,manifest_file_number is 1629, next_file_number is 1631, last_sequence is 500846, log_number is 0,prev_log_number is 0,max_column_family is 0
- 2018-04-17 04:35:27.522324 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.522347 I | rook-ceph-mon0: -574> 2018-04-17 04:35:17.468204 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 1624
- 2018-04-17 04:35:27.522359 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.522371 I | rook-ceph-mon0: -573> 2018-04-17 04:35:17.468417 7f383871cf00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1523939717468403, "job": 1, "event": "recovery_started", "log_files": [1630]}
- 2018-04-17 04:35:27.522382 I | rook-ceph-mon0: -572> 2018-04-17 04:35:17.468446 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/db_impl_open.cc:482] Recovering log #1630 mode 2
- 2018-04-17 04:35:27.522407 I | rook-ceph-mon0: -571> 2018-04-17 04:35:17.468974 7f383871cf00 5 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/db_impl_open.cc:815] [default] [WriteLevel0TableForRecovery] Level-0 table #1631: started
- 2018-04-17 04:35:27.522421 I | rook-ceph-mon0: -570> 2018-04-17 04:35:17.471307 7f383871cf00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1523939717471292, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 1631, "file_size": 1067, "table_properties": {"data_size": 116, "index_size": 27, "filter_size": 18, "raw_key_size": 76, "raw_average_key_size": 25, "raw_value_size": 24, "raw_average_value_size": 8, "num_data_blocks": 1, "num_entries": 3, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018-04-17 04:35:27.522434 I | rook-ceph-mon0: -569> 2018-04-17 04:35:17.471331 7f383871cf00 5 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/db_impl_open.cc:847] [default] [WriteLevel0TableForRecovery] Level-0 table #1631: 1067 bytes OK
- 2018-04-17 04:35:27.522446 I | rook-ceph-mon0: -568> 2018-04-17 04:35:17.471360 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/version_set.cc:2395] Creating manifest 1632
- 2018-04-17 04:35:27.522459 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.522471 I | rook-ceph-mon0: -567> 2018-04-17 04:35:17.473879 7f383871cf00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1523939717473872, "job": 1, "event": "recovery_finished"}
- 2018-04-17 04:35:27.522483 I | rook-ceph-mon0: -566> 2018-04-17 04:35:17.474285 7f383871cf00 5 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/db_impl_files.cc:307] [JOB 2] Delete /var/lib/rook/rook-ceph-mon0/data/store.db//MANIFEST-001629 type=3 #1629 -- OK
- 2018-04-17 04:35:27.522494 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.522506 I | rook-ceph-mon0: -565> 2018-04-17 04:35:17.474363 7f383871cf00 5 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/db_impl_files.cc:307] [JOB 2] Delete /var/lib/rook/rook-ceph-mon0/data/store.db//001630.log type=0 #1630 -- OK
- 2018-04-17 04:35:27.522517 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.522528 I | rook-ceph-mon0: -564> 2018-04-17 04:35:17.477053 7f383871cf00 4 rocksdb: [/build/ceph-12.2.4/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55d3912c2000
- 2018-04-17 04:35:27.522540 I | rook-ceph-mon0: -563> 2018-04-17 04:35:17.479158 7f382bd67700 2 Event(0x55d390f34bc0 nevent=5000 time_id=1).set_owner idx=0 owner=139879230371584
- 2018-04-17 04:35:27.522551 I | rook-ceph-mon0: -562> 2018-04-17 04:35:17.479220 7f382c568700 2 Event(0x55d390f34740 nevent=5000 time_id=1).set_owner idx=1 owner=139879238764288
- 2018-04-17 04:35:27.522563 I | rook-ceph-mon0: -561> 2018-04-17 04:35:17.479328 7f382cd69700 2 Event(0x55d390f34e00 nevent=5000 time_id=1).set_owner idx=2 owner=139879247156992
- 2018-04-17 04:35:27.522575 I | rook-ceph-mon0: -560> 2018-04-17 04:35:17.479439 7f383871cf00 0 starting mon.rook-ceph-mon0 rank 1 at public addr 10.107.181.203:6790/0 at bind addr 192.168.33.45:6790/0 mon_data /var/lib/rook/rook-ceph-mon0/data fsid d4f1a1ca-b919-4c5b-89f2-1aed3d913a97
- 2018-04-17 04:35:27.522587 I | rook-ceph-mon0: -559> 2018-04-17 04:35:17.479675 7f383871cf00 1 -- 192.168.33.45:6790/0 learned_addr learned my addr 192.168.33.45:6790/0
- 2018-04-17 04:35:27.522598 I | rook-ceph-mon0: -558> 2018-04-17 04:35:17.479753 7f383871cf00 1 -- 192.168.33.45:6790/0 _finish_bind bind my_inst.addr is 192.168.33.45:6790/0
- 2018-04-17 04:35:27.522610 I | rook-ceph-mon0: -557> 2018-04-17 04:35:17.479805 7f383871cf00 0 starting mon.rook-ceph-mon0 rank 1 at 10.107.181.203:6790/0 mon_data /var/lib/rook/rook-ceph-mon0/data fsid d4f1a1ca-b919-4c5b-89f2-1aed3d913a97
- 2018-04-17 04:35:27.522621 I | rook-ceph-mon0: -556> 2018-04-17 04:35:17.479893 7f383871cf00 5 adding auth protocol: cephx
- 2018-04-17 04:35:27.522633 I | rook-ceph-mon0: -555> 2018-04-17 04:35:17.479918 7f383871cf00 5 adding auth protocol: cephx
- 2018-04-17 04:35:27.522645 I | rook-ceph-mon0: -554> 2018-04-17 04:35:17.479962 7f383871cf00 10 log_channel(cluster) update_config to_monitors: true to_syslog: false syslog_facility: daemon prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201)
- 2018-04-17 04:35:27.522657 I | rook-ceph-mon0: -553> 2018-04-17 04:35:17.479992 7f383871cf00 10 log_channel(audit) update_config to_monitors: true to_syslog: false syslog_facility: local0 prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201)
- 2018-04-17 04:35:27.522698 I | rook-ceph-mon0: -552> 2018-04-17 04:35:17.482095 7f383871cf00 1 mon.rook-ceph-mon0@-1(probing).paxosservice(pgmap 1..2) refresh upgraded, format 0 -> 1
- 2018-04-17 04:35:27.522713 I | rook-ceph-mon0: -551> 2018-04-17 04:35:17.482361 7f383871cf00 0 mon.rook-ceph-mon0@-1(probing).mds e20 print_map
- 2018-04-17 04:35:27.522724 I | rook-ceph-mon0: e20
- 2018-04-17 04:35:27.522736 I | rook-ceph-mon0: enable_multiple, ever_enabled_multiple: 1,1
- 2018-04-17 04:35:27.522748 I | rook-ceph-mon0: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2}
- 2018-04-17 04:35:27.522763 I | rook-ceph-mon0: legacy client fscid: 1
- 2018-04-17 04:35:27.522781 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.522801 I | rook-ceph-mon0: Filesystem 'fsvolume' (1)
- 2018-04-17 04:35:27.522820 I | rook-ceph-mon0: fs_name fsvolume
- 2018-04-17 04:35:27.522838 I | rook-ceph-mon0: epoch 17
- 2018-04-17 04:35:27.522853 I | rook-ceph-mon0: flags c
- 2018-04-17 04:35:27.522870 I | rook-ceph-mon0: created 2018-04-15 20:14:35.621106
- 2018-04-17 04:35:27.522906 I | rook-ceph-mon0: modified 2018-04-15 20:14:35.621109
- 2018-04-17 04:35:27.522926 I | rook-ceph-mon0: tableserver 0
- 2018-04-17 04:35:27.522943 I | rook-ceph-mon0: root 0
- 2018-04-17 04:35:27.522960 I | rook-ceph-mon0: session_timeout 60
- 2018-04-17 04:35:27.522979 I | rook-ceph-mon0: session_autoclose 300
- 2018-04-17 04:35:27.522996 I | rook-ceph-mon0: max_file_size 1099511627776
- 2018-04-17 04:35:27.523013 I | rook-ceph-mon0: last_failure 0
- 2018-04-17 04:35:27.523031 I | rook-ceph-mon0: last_failure_osd_epoch 38
- 2018-04-17 04:35:27.523050 I | rook-ceph-mon0: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2}
- 2018-04-17 04:35:27.523068 I | rook-ceph-mon0: max_mds 1
- 2018-04-17 04:35:27.523084 I | rook-ceph-mon0: in 0
- 2018-04-17 04:35:27.523102 I | rook-ceph-mon0: up {0=4243}
- 2018-04-17 04:35:27.523119 I | rook-ceph-mon0: failed
- 2018-04-17 04:35:27.523136 I | rook-ceph-mon0: damaged
- 2018-04-17 04:35:27.523151 I | rook-ceph-mon0: stopped
- 2018-04-17 04:35:27.523168 I | rook-ceph-mon0: data_pools [2]
- 2018-04-17 04:35:27.523184 I | rook-ceph-mon0: metadata_pool 1
- 2018-04-17 04:35:27.523202 I | rook-ceph-mon0: inline_data disabled
- 2018-04-17 04:35:27.523220 I | rook-ceph-mon0: balancer
- 2018-04-17 04:35:27.523237 I | rook-ceph-mon0: standby_count_wanted 1
- 2018-04-17 04:35:27.523256 I | rook-ceph-mon0: 4243: 192.168.108.189:6800/3866860933 'mlk6nk' mds.0.14 up:active seq 20607
- 2018-04-17 04:35:27.523273 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.523292 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.523318 I | rook-ceph-mon0: Filesystem 'bypfs' (2)
- 2018-04-17 04:35:27.523335 I | rook-ceph-mon0: fs_name bypfs
- 2018-04-17 04:35:27.523350 I | rook-ceph-mon0: epoch 19
- 2018-04-17 04:35:27.523366 I | rook-ceph-mon0: flags c
- 2018-04-17 04:35:27.523384 I | rook-ceph-mon0: created 2018-04-15 20:19:50.402008
- 2018-04-17 04:35:27.523401 I | rook-ceph-mon0: modified 2018-04-15 20:19:50.402010
- 2018-04-17 04:35:27.523418 I | rook-ceph-mon0: tableserver 0
- 2018-04-17 04:35:27.523435 I | rook-ceph-mon0: root 0
- 2018-04-17 04:35:27.523454 I | rook-ceph-mon0: session_timeout 60
- 2018-04-17 04:35:27.523471 I | rook-ceph-mon0: session_autoclose 300
- 2018-04-17 04:35:27.523489 I | rook-ceph-mon0: max_file_size 1099511627776
- 2018-04-17 04:35:27.523507 I | rook-ceph-mon0: last_failure 0
- 2018-04-17 04:35:27.523525 I | rook-ceph-mon0: last_failure_osd_epoch 38
- 2018-04-17 04:35:27.523542 I | rook-ceph-mon0: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2}
- 2018-04-17 04:35:27.523559 I | rook-ceph-mon0: max_mds 1
- 2018-04-17 04:35:27.523577 I | rook-ceph-mon0: in 0
- 2018-04-17 04:35:27.523593 I | rook-ceph-mon0: up {0=4339}
- 2018-04-17 04:35:27.523611 I | rook-ceph-mon0: failed
- 2018-04-17 04:35:27.523628 I | rook-ceph-mon0: damaged
- 2018-04-17 04:35:27.523645 I | rook-ceph-mon0: stopped
- 2018-04-17 04:35:27.523664 I | rook-ceph-mon0: data_pools [4]
- 2018-04-17 04:35:27.523709 I | rook-ceph-mon0: metadata_pool 3
- 2018-04-17 04:35:27.523730 I | rook-ceph-mon0: inline_data disabled
- 2018-04-17 04:35:27.523749 I | rook-ceph-mon0: balancer
- 2018-04-17 04:35:27.523768 I | rook-ceph-mon0: standby_count_wanted 1
- 2018-04-17 04:35:27.523821 I | rook-ceph-mon0: 4339: 192.168.108.137:6800/3657245232 'mzlvk8' mds.0.14 up:active seq 20539
- 2018-04-17 04:35:27.523842 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.523884 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.523901 I | rook-ceph-mon0: Standby daemons:
- 2018-04-17 04:35:27.523918 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.523945 I | rook-ceph-mon0: 28380: 192.168.59.29:6800/1514657449 'm64rcg' mds.-1.0 up:standby seq 2
- 2018-04-17 04:35:27.523974 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.523994 I | rook-ceph-mon0: -550> 2018-04-17 04:35:17.482923 7f383871cf00 0 mon.rook-ceph-mon0@-1(probing).osd e40 crush map has features 2200130813952, adjusting msgr requires
- 2018-04-17 04:35:27.524019 I | rook-ceph-mon0: -549> 2018-04-17 04:35:17.482943 7f383871cf00 0 mon.rook-ceph-mon0@-1(probing).osd e40 crush map has features 2200130813952, adjusting msgr requires
- 2018-04-17 04:35:27.524038 I | rook-ceph-mon0: -548> 2018-04-17 04:35:17.482950 7f383871cf00 0 mon.rook-ceph-mon0@-1(probing).osd e40 crush map has features 720578140510109696, adjusting msgr requires
- 2018-04-17 04:35:27.524066 I | rook-ceph-mon0: -547> 2018-04-17 04:35:17.482955 7f383871cf00 0 mon.rook-ceph-mon0@-1(probing).osd e40 crush map has features 2200130813952, adjusting msgr requires
- 2018-04-17 04:35:27.524087 I | rook-ceph-mon0: -546> 2018-04-17 04:35:17.483520 7f383871cf00 1 mon.rook-ceph-mon0@-1(probing).paxosservice(auth 1..35) refresh upgraded, format 0 -> 2
- 2018-04-17 04:35:27.524105 I | rook-ceph-mon0: -545> 2018-04-17 04:35:17.487538 7f383871cf00 4 mgrc handle_mgr_map Got map version 5
- 2018-04-17 04:35:27.524122 I | rook-ceph-mon0: -544> 2018-04-17 04:35:17.487559 7f383871cf00 4 mgrc handle_mgr_map Active mgr is now -
- 2018-04-17 04:35:27.524154 I | rook-ceph-mon0: -543> 2018-04-17 04:35:17.487563 7f383871cf00 4 mgrc reconnect No active mgr available yet
- 2018-04-17 04:35:27.524174 I | rook-ceph-mon0: -542> 2018-04-17 04:35:17.488012 7f383871cf00 2 auth: KeyRing::load: loaded key file /var/lib/rook/rook-ceph-mon0/data/keyring
- 2018-04-17 04:35:27.524192 I | rook-ceph-mon0: -541> 2018-04-17 04:35:17.488034 7f383871cf00 5 asok(0x55d390eaf4a0) register_command mon_status hook 0x55d390eaa6b0
- 2018-04-17 04:35:27.524209 I | rook-ceph-mon0: -540> 2018-04-17 04:35:17.488043 7f383871cf00 5 asok(0x55d390eaf4a0) register_command quorum_status hook 0x55d390eaa6b0
- 2018-04-17 04:35:27.524228 I | rook-ceph-mon0: -539> 2018-04-17 04:35:17.488049 7f383871cf00 5 asok(0x55d390eaf4a0) register_command sync_force hook 0x55d390eaa6b0
- 2018-04-17 04:35:27.524262 I | rook-ceph-mon0: -538> 2018-04-17 04:35:17.488054 7f383871cf00 5 asok(0x55d390eaf4a0) register_command add_bootstrap_peer_hint hook 0x55d390eaa6b0
- 2018-04-17 04:35:27.524281 I | rook-ceph-mon0: -537> 2018-04-17 04:35:17.488069 7f383871cf00 5 asok(0x55d390eaf4a0) register_command quorum enter hook 0x55d390eaa6b0
- 2018-04-17 04:35:27.524299 I | rook-ceph-mon0: -536> 2018-04-17 04:35:17.488074 7f383871cf00 5 asok(0x55d390eaf4a0) register_command quorum exit hook 0x55d390eaa6b0
- 2018-04-17 04:35:27.524319 I | rook-ceph-mon0: -535> 2018-04-17 04:35:17.488082 7f383871cf00 5 asok(0x55d390eaf4a0) register_command ops hook 0x55d390eaa6b0
- 2018-04-17 04:35:27.524337 I | rook-ceph-mon0: -534> 2018-04-17 04:35:17.488097 7f383871cf00 5 asok(0x55d390eaf4a0) register_command sessions hook 0x55d390eaa6b0
- 2018-04-17 04:35:27.524356 I | rook-ceph-mon0: -533> 2018-04-17 04:35:17.488143 7f383871cf00 1 -- 10.107.181.203:6790/0 start start
- 2018-04-17 04:35:27.524375 I | rook-ceph-mon0: -532> 2018-04-17 04:35:17.488161 7f383871cf00 1 -- - start start
- 2018-04-17 04:35:27.524393 I | rook-ceph-mon0: -531> 2018-04-17 04:35:17.488874 7f383871cf00 1 Processor -- start
- 2018-04-17 04:35:27.524407 I | rook-ceph-mon0: -530> 2018-04-17 04:35:17.489817 7f383871cf00 1 Processor -- start
- 2018-04-17 04:35:27.524419 I | rook-ceph-mon0: -529> 2018-04-17 04:35:17.490051 7f383871cf00 0 mon.rook-ceph-mon0@-1(probing) e3 my rank is now 1 (was -1)
- 2018-04-17 04:35:27.524431 I | rook-ceph-mon0: -528> 2018-04-17 04:35:17.490068 7f383871cf00 1 -- 10.107.181.203:6790/0 shutdown_connections
- 2018-04-17 04:35:27.524461 I | rook-ceph-mon0: -527> 2018-04-17 04:35:17.490089 7f383871cf00 1 -- 10.107.181.203:6790/0 _send_message--> mon.0 10.97.51.86:6790/0 -- mon_probe(probe d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 name rook-ceph-mon0) v6 -- ?+0 0x55d391201080
- 2018-04-17 04:35:27.524481 I | rook-ceph-mon0: -526> 2018-04-17 04:35:17.490137 7f383871cf00 1 -- 10.107.181.203:6790/0 --> 10.97.51.86:6790/0 -- mon_probe(probe d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 name rook-ceph-mon0) v6 -- 0x55d391201080 con 0
- 2018-04-17 04:35:27.524500 I | rook-ceph-mon0: -525> 2018-04-17 04:35:17.490178 7f383871cf00 1 -- 10.107.181.203:6790/0 _send_message--> mon.2 10.111.191.96:6790/0 -- mon_probe(probe d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 name rook-ceph-mon0) v6 -- ?+0 0x55d391201340
- 2018-04-17 04:35:27.524518 I | rook-ceph-mon0: -524> 2018-04-17 04:35:17.490221 7f383871cf00 1 -- 10.107.181.203:6790/0 --> 10.111.191.96:6790/0 -- mon_probe(probe d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 name rook-ceph-mon0) v6 -- 0x55d391201340 con 0
- 2018-04-17 04:35:27.524549 I | rook-ceph-mon0: -523> 2018-04-17 04:35:17.492796 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got RETRY_GLOBAL 1269 chose new 1270
- 2018-04-17 04:35:27.524569 I | rook-ceph-mon0: -522> 2018-04-17 04:35:17.493924 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_CONNECTING_WAIT_CONNECT_REPLY_AUTH pgs=0 cs=0 l=0).handle_connect_reply connect got RETRY_GLOBAL 1269 chose new 1271
- 2018-04-17 04:35:27.524587 I | rook-ceph-mon0: -521> 2018-04-17 04:35:17.495795 7f382bd67700 0 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0).process missed message? skipped from seq 0 to 776240641
- 2018-04-17 04:35:27.524606 I | rook-ceph-mon0: -520> 2018-04-17 04:35:17.495834 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240641 0x55d391201340 mon_probe(reply d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 name rook-ceph-mon2 paxos( fc 48193 lc 48881 )) v6
- 2018-04-17 04:35:27.524629 I | rook-ceph-mon0: -519> 2018-04-17 04:35:17.495890 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240641 ==== mon_probe(reply d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 name rook-ceph-mon2 paxos( fc 48193 lc 48881 )) v6 ==== 545+0+0 (987818267 0 0) 0x55d391201340 con 0x55d39147a800
- 2018-04-17 04:35:27.524649 I | rook-ceph-mon0: -518> 2018-04-17 04:35:17.495983 7f382fd6f700 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon0 calling monitor election
- 2018-04-17 04:35:27.524666 I | rook-ceph-mon0: -517> 2018-04-17 04:35:17.495991 7f382fd6f700 10 log_client _send_to_monlog to self
- 2018-04-17 04:35:27.524711 I | rook-ceph-mon0: -516> 2018-04-17 04:35:17.495994 7f382fd6f700 10 log_client log_queue is 1 last_log 1 sent 0 num 1 unsent 1 sending 1
- 2018-04-17 04:35:27.524733 I | rook-ceph-mon0: -515> 2018-04-17 04:35:17.495999 7f382fd6f700 10 log_client will send 2018-04-17 04:35:17.495988 mon.rook-ceph-mon0 mon.1 10.107.181.203:6790/0 1 : cluster [INF] mon.rook-ceph-mon0 calling monitor election
- 2018-04-17 04:35:27.524749 I | rook-ceph-mon0: -514> 2018-04-17 04:35:17.496022 7f382fd6f700 1 -- 10.107.181.203:6790/0 --> 10.107.181.203:6790/0 -- log(1 entries from seq 1 at 2018-04-17 04:35:17.495988) v1 -- 0x55d390eb9700 con 0
- 2018-04-17 04:35:27.524761 I | rook-ceph-mon0: -513> 2018-04-17 04:35:17.498240 7f382fd6f700 1 -- 10.107.181.203:6790/0 _send_message--> mon.0 10.97.51.86:6790/0 -- election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 propose 957) v7 -- ?+0 0x55d3912f09c0
- 2018-04-17 04:35:27.524774 I | rook-ceph-mon0: -512> 2018-04-17 04:35:17.498265 7f382fd6f700 1 -- 10.107.181.203:6790/0 --> 10.97.51.86:6790/0 -- election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 propose 957) v7 -- 0x55d3912f09c0 con 0
- 2018-04-17 04:35:27.524786 I | rook-ceph-mon0: -511> 2018-04-17 04:35:17.498348 7f382fd6f700 1 -- 10.107.181.203:6790/0 _send_message--> mon.2 10.111.191.96:6790/0 -- election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 propose 957) v7 -- ?+0 0x55d3912f0d00
- 2018-04-17 04:35:27.524798 I | rook-ceph-mon0: -510> 2018-04-17 04:35:17.498370 7f382fd6f700 1 -- 10.107.181.203:6790/0 --> 10.111.191.96:6790/0 -- election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 propose 957) v7 -- 0x55d3912f0d00 con 0
- 2018-04-17 04:35:27.524810 I | rook-ceph-mon0: -509> 2018-04-17 04:35:17.498411 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.1 10.107.181.203:6790/0 0 ==== log(1 entries from seq 1 at 2018-04-17 04:35:17.495988) v1 ==== 0+0+0 (0 0 0) 0x55d390eb9700 con 0x55d390f0f800
- 2018-04-17 04:35:27.524841 I | rook-ceph-mon0: -508> 2018-04-17 04:35:17.498448 7f382fd6f700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:17.498450 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.524862 I | rook-ceph-mon0: -507> 2018-04-17 04:35:17.498469 7f382fd6f700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:17.498472 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.524881 I | rook-ceph-mon0: -506> 2018-04-17 04:35:18.039811 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240642 0x55d391201b80 mon_probe(probe d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 name rook-ceph-mon2) v6
- 2018-04-17 04:35:27.524900 I | rook-ceph-mon0: -505> 2018-04-17 04:35:18.039972 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240642 ==== mon_probe(probe d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 name rook-ceph-mon2) v6 ==== 71+0+0 (1950368020 0 0) 0x55d391201b80 con 0x55d39147a800
- 2018-04-17 04:35:27.524922 I | rook-ceph-mon0: -504> 2018-04-17 04:35:18.040076 7f382fd6f700 1 -- 10.107.181.203:6790/0 --> 10.111.191.96:6790/0 -- mon_probe(reply d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 name rook-ceph-mon0 paxos( fc 48193 lc 48881 )) v6 -- 0x55d391201340 con 0
- 2018-04-17 04:35:27.524941 I | rook-ceph-mon0: -503> 2018-04-17 04:35:18.042942 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240643 0x55d3912f0d00 election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 propose 957) v7
- 2018-04-17 04:35:27.524964 I | rook-ceph-mon0: -502> 2018-04-17 04:35:18.043065 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240643 ==== election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 propose 957) v7 ==== 552+0+0 (460036614 0 0) 0x55d3912f0d00 con 0x55d39147a800
- 2018-04-17 04:35:27.524983 I | rook-ceph-mon0: -501> 2018-04-17 04:35:18.132175 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914a1800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=34 -
- 2018-04-17 04:35:27.525002 I | rook-ceph-mon0: -500> 2018-04-17 04:35:18.132599 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a1800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=4 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.525020 I | rook-ceph-mon0: -499> 2018-04-17 04:35:18.132813 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a1800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=4 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.525037 I | rook-ceph-mon0: -498> 2018-04-17 04:35:18.132954 7f382c568700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a1800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4 cs=1 l=1). rx unknown.0 seq 1 0x55d3914b6000 auth(proto 0 34 bytes epoch 0)
- 2018-04-17 04:35:27.525056 I | rook-ceph-mon0: -497> 2018-04-17 04:35:18.133037 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== unknown.0 192.168.33.0:0/1017577090 1 ==== auth(proto 0 34 bytes epoch 0) ==== 60+0+0 (3679117932 0 0) 0x55d3914b6000 con 0x55d3914a1800
- 2018-04-17 04:35:27.525075 I | rook-ceph-mon0: -496> 2018-04-17 04:35:18.164087 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914a3000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=35 -
- 2018-04-17 04:35:27.525094 I | rook-ceph-mon0: -495> 2018-04-17 04:35:18.164784 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914a3000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=550 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.525112 I | rook-ceph-mon0: -494> 2018-04-17 04:35:18.165263 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914a3000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=550 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.525127 I | rook-ceph-mon0: -493> 2018-04-17 04:35:18.165365 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914a3000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=550 cs=1 l=1). rx client.? seq 1 0x55d390eb9c00 auth(proto 0 39 bytes epoch 0) v1
- 2018-04-17 04:35:27.525142 I | rook-ceph-mon0: -492> 2018-04-17 04:35:18.165440 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.249.1:0/2171750696 1 ==== auth(proto 0 39 bytes epoch 0) v1 ==== 69+0+0 (914456824 0 0) 0x55d390eb9c00 con 0x55d3914a3000
- 2018-04-17 04:35:27.525178 I | rook-ceph-mon0: -491> 2018-04-17 04:35:18.272775 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914a4800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=36 -
- 2018-04-17 04:35:27.525198 I | rook-ceph-mon0: -490> 2018-04-17 04:35:18.273658 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914a4800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=124 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.525220 I | rook-ceph-mon0: -489> 2018-04-17 04:35:18.274151 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914a4800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=124 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.525239 I | rook-ceph-mon0: -488> 2018-04-17 04:35:18.274393 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914a4800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=124 cs=1 l=1). rx client.? seq 1 0x55d3914b6280 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.525258 I | rook-ceph-mon0: -487> 2018-04-17 04:35:18.274503 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.59.0:0/1209919990 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b6280 con 0x55d3914a4800
- 2018-04-17 04:35:27.525276 I | rook-ceph-mon0: -486> 2018-04-17 04:35:18.555479 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914c2000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=37 -
- 2018-04-17 04:35:27.525295 I | rook-ceph-mon0: -485> 2018-04-17 04:35:18.556004 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d3914c2000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=135 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.525314 I | rook-ceph-mon0: -484> 2018-04-17 04:35:18.556086 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d3914c2000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=135 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.525335 I | rook-ceph-mon0: -483> 2018-04-17 04:35:18.556336 7f382c568700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d3914c2000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=135 cs=1 l=1). rx client.? seq 1 0x55d3914b6500 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.525353 I | rook-ceph-mon0: -482> 2018-04-17 04:35:18.556557 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.33.0:0/3926288723 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b6500 con 0x55d3914c2000
- 2018-04-17 04:35:27.525372 I | rook-ceph-mon0: -481> 2018-04-17 04:35:18.741465 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914c3800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=38 -
- 2018-04-17 04:35:27.525389 I | rook-ceph-mon0: -480> 2018-04-17 04:35:18.742409 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d3914c3800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=178 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.525407 I | rook-ceph-mon0: -479> 2018-04-17 04:35:18.743000 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d3914c3800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=178 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.525425 I | rook-ceph-mon0: -478> 2018-04-17 04:35:18.743067 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d3914c3800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=178 cs=1 l=1). rx client.? seq 1 0x55d3914b6a00 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.525444 I | rook-ceph-mon0: -477> 2018-04-17 04:35:18.743149 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.249.1:0/2662115732 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b6a00 con 0x55d3914c3800
- 2018-04-17 04:35:27.525463 I | rook-ceph-mon0: -476> 2018-04-17 04:35:18.871676 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914c5000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=39 -
- 2018-04-17 04:35:27.525484 I | rook-ceph-mon0: -475> 2018-04-17 04:35:18.872664 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d3914c5000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=350 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.525506 I | rook-ceph-mon0: -474> 2018-04-17 04:35:18.873013 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d3914c5000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=350 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.525548 I | rook-ceph-mon0: -473> 2018-04-17 04:35:18.873196 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d3914c5000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=350 cs=1 l=1). rx osd.0 seq 1 0x55d3914b7180 auth(proto 0 26 bytes epoch 0) v1
- 2018-04-17 04:35:27.525569 I | rook-ceph-mon0: -472> 2018-04-17 04:35:18.873330 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== osd.0 192.168.108.184:6800/29 1 ==== auth(proto 0 26 bytes epoch 0) v1 ==== 56+0+0 (3942267087 0 0) 0x55d3914b7180 con 0x55d3914c5000
- 2018-04-17 04:35:27.525590 I | rook-ceph-mon0: -471> 2018-04-17 04:35:18.938590 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914c6800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=40 -
- 2018-04-17 04:35:27.525608 I | rook-ceph-mon0: -470> 2018-04-17 04:35:18.939040 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d3914c6800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=179 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.525626 I | rook-ceph-mon0: -469> 2018-04-17 04:35:18.939294 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d3914c6800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=179 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.525648 I | rook-ceph-mon0: -468> 2018-04-17 04:35:18.939450 7f382c568700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d3914c6800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=179 cs=1 l=1). rx client.? seq 1 0x55d3914b6780 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.525669 I | rook-ceph-mon0: -467> 2018-04-17 04:35:18.939556 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.33.0:0/823466689 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b6780 con 0x55d3914c6800
- 2018-04-17 04:35:27.525826 I | rook-ceph-mon0: -466> 2018-04-17 04:35:19.092344 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914d4000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=41 -
- 2018-04-17 04:35:27.525841 I | rook-ceph-mon0: -465> 2018-04-17 04:35:19.092753 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/726206361 conn(0x55d3914d4000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=3 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.525853 I | rook-ceph-mon0: -464> 2018-04-17 04:35:19.092961 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/726206361 conn(0x55d3914d4000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=3 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.525865 I | rook-ceph-mon0: -463> 2018-04-17 04:35:19.093029 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/726206361 conn(0x55d3914d4000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=3 cs=1 l=1). rx unknown.0 seq 1 0x55d3914b6c80 auth(proto 0 34 bytes epoch 0)
- 2018-04-17 04:35:27.525878 I | rook-ceph-mon0: -462> 2018-04-17 04:35:19.093093 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== unknown.0 192.168.33.0:0/726206361 1 ==== auth(proto 0 34 bytes epoch 0) ==== 60+0+0 (3679117932 0 0) 0x55d3914b6c80 con 0x55d3914d4000
- 2018-04-17 04:35:27.525889 I | rook-ceph-mon0: -461> 2018-04-17 04:35:19.156150 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914d5800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=42 -
- 2018-04-17 04:35:27.525904 I | rook-ceph-mon0: -460> 2018-04-17 04:35:19.156471 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d3914d5800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=3 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.525926 I | rook-ceph-mon0: -459> 2018-04-17 04:35:19.156654 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d3914d5800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=3 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.525946 I | rook-ceph-mon0: -458> 2018-04-17 04:35:19.156784 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d3914d5800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=3 cs=1 l=1). rx unknown.0 seq 1 0x55d3914b7400 auth(proto 0 34 bytes epoch 0)
- 2018-04-17 04:35:27.525962 I | rook-ceph-mon0: -457> 2018-04-17 04:35:19.156870 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== unknown.0 192.168.33.0:0/3111804194 1 ==== auth(proto 0 34 bytes epoch 0) ==== 60+0+0 (3679117932 0 0) 0x55d3914b7400 con 0x55d3914d5800
- 2018-04-17 04:35:27.525974 I | rook-ceph-mon0: -456> 2018-04-17 04:35:19.498784 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914d7000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=43 -
- 2018-04-17 04:35:27.526002 I | rook-ceph-mon0: -455> 2018-04-17 04:35:19.499464 7f382c568700 2 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d3914d7000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=75 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.526023 I | rook-ceph-mon0: -454> 2018-04-17 04:35:19.499746 7f382c568700 2 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d3914d7000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=75 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.526042 I | rook-ceph-mon0: -453> 2018-04-17 04:35:19.499919 7f382c568700 5 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d3914d7000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=75 cs=1 l=1). rx client.? seq 1 0x55d3914b7680 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.526061 I | rook-ceph-mon0: -452> 2018-04-17 04:35:19.499995 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 199.96.132.12:0/2329353454 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b7680 con 0x55d3914d7000
- 2018-04-17 04:35:27.526085 I | rook-ceph-mon0: -451> 2018-04-17 04:35:19.539029 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914d8800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=44 -
- 2018-04-17 04:35:27.526103 I | rook-ceph-mon0: -450> 2018-04-17 04:35:19.539714 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d3914d8800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=80 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.526121 I | rook-ceph-mon0: -449> 2018-04-17 04:35:19.539757 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d3914d8800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=80 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.526139 I | rook-ceph-mon0: -448> 2018-04-17 04:35:19.539977 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d3914d8800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=80 cs=1 l=1). rx client.? seq 1 0x55d3914b6f00 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.526157 I | rook-ceph-mon0: -447> 2018-04-17 04:35:19.540057 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.33.0:0/2502043250 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b6f00 con 0x55d3914d8800
- 2018-04-17 04:35:27.526175 I | rook-ceph-mon0: -446> 2018-04-17 04:35:19.773701 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914ee000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=45 -
- 2018-04-17 04:35:27.526194 I | rook-ceph-mon0: -445> 2018-04-17 04:35:19.774508 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d3914ee000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=80 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.526218 I | rook-ceph-mon0: -444> 2018-04-17 04:35:19.774927 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d3914ee000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=80 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.526237 I | rook-ceph-mon0: -443> 2018-04-17 04:35:19.774986 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d3914ee000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=80 cs=1 l=1). rx client.? seq 1 0x55d3914b7e00 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.526253 I | rook-ceph-mon0: -442> 2018-04-17 04:35:19.775081 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.249.1:0/2144414442 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b7e00 con 0x55d3914ee000
- 2018-04-17 04:35:27.526271 I | rook-ceph-mon0: -441> 2018-04-17 04:35:19.839683 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914ef800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=46 -
- 2018-04-17 04:35:27.526289 I | rook-ceph-mon0: -440> 2018-04-17 04:35:19.840180 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914f1000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=47 -
- 2018-04-17 04:35:27.526307 I | rook-ceph-mon0: -439> 2018-04-17 04:35:19.840969 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914f1000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=136 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.526328 I | rook-ceph-mon0: -438> 2018-04-17 04:35:19.841485 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914f1000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=136 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.526362 I | rook-ceph-mon0: -437> 2018-04-17 04:35:19.841542 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914f1000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=136 cs=1 l=1). rx client.? seq 1 0x55d3914b8580 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.526383 I | rook-ceph-mon0: -436> 2018-04-17 04:35:19.841606 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.249.1:0/3332407889 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b8580 con 0x55d3914f1000
- 2018-04-17 04:35:27.526403 I | rook-ceph-mon0: -435> 2018-04-17 04:35:19.843399 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2457710081 conn(0x55d3914ef800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=4 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.526422 I | rook-ceph-mon0: -434> 2018-04-17 04:35:19.843889 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2457710081 conn(0x55d3914ef800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=4 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.526441 I | rook-ceph-mon0: -433> 2018-04-17 04:35:19.843941 7f382c568700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2457710081 conn(0x55d3914ef800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4 cs=1 l=1). rx unknown.0 seq 1 0x55d3914b7900 auth(proto 0 34 bytes epoch 0)
- 2018-04-17 04:35:27.526459 I | rook-ceph-mon0: -432> 2018-04-17 04:35:19.843993 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== unknown.0 192.168.249.1:0/2457710081 1 ==== auth(proto 0 34 bytes epoch 0) ==== 60+0+0 (3679117932 0 0) 0x55d3914b7900 con 0x55d3914ef800
- 2018-04-17 04:35:27.526477 I | rook-ceph-mon0: -431> 2018-04-17 04:35:20.115885 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a1800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).read_bulk peer close file descriptor 34
- 2018-04-17 04:35:27.526496 I | rook-ceph-mon0: -430> 2018-04-17 04:35:20.115934 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a1800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.526518 I | rook-ceph-mon0: -429> 2018-04-17 04:35:20.115951 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a1800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.526537 I | rook-ceph-mon0: -428> 2018-04-17 04:35:20.115971 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a1800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.526556 I | rook-ceph-mon0: -427> 2018-04-17 04:35:20.115994 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a1800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1)._stop
- 2018-04-17 04:35:27.526575 I | rook-ceph-mon0: -426> 2018-04-17 04:35:20.116224 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914f2800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=48 -
- 2018-04-17 04:35:27.526592 I | rook-ceph-mon0: -425> 2018-04-17 04:35:20.116529 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d3914f2800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=4 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.526615 I | rook-ceph-mon0: -424> 2018-04-17 04:35:20.116663 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d3914f2800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=4 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.526633 I | rook-ceph-mon0: -423> 2018-04-17 04:35:20.116814 7f382c568700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d3914f2800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4 cs=1 l=1). rx unknown.0 seq 1 0x55d3914b7b80 auth(proto 0 34 bytes epoch 0)
- 2018-04-17 04:35:27.526652 I | rook-ceph-mon0: -422> 2018-04-17 04:35:20.116922 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== unknown.0 192.168.33.0:0/4209033655 1 ==== auth(proto 0 34 bytes epoch 0) ==== 60+0+0 (3679117932 0 0) 0x55d3914b7b80 con 0x55d3914f2800
- 2018-04-17 04:35:27.526670 I | rook-ceph-mon0: -421> 2018-04-17 04:35:21.163826 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914a3000 :6790 s=STATE_OPEN pgs=550 cs=1 l=1).read_bulk peer close file descriptor 35
- 2018-04-17 04:35:27.526715 I | rook-ceph-mon0: -420> 2018-04-17 04:35:21.163887 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914a3000 :6790 s=STATE_OPEN pgs=550 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.526735 I | rook-ceph-mon0: -419> 2018-04-17 04:35:21.163901 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914a3000 :6790 s=STATE_OPEN pgs=550 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.526765 I | rook-ceph-mon0: -418> 2018-04-17 04:35:21.163909 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914a3000 :6790 s=STATE_OPEN pgs=550 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.526784 I | rook-ceph-mon0: -417> 2018-04-17 04:35:21.163917 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914a3000 :6790 s=STATE_OPEN pgs=550 cs=1 l=1)._stop
- 2018-04-17 04:35:27.526807 I | rook-ceph-mon0: -416> 2018-04-17 04:35:21.272340 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914a4800 :6790 s=STATE_OPEN pgs=124 cs=1 l=1).read_bulk peer close file descriptor 36
- 2018-04-17 04:35:27.526829 I | rook-ceph-mon0: -415> 2018-04-17 04:35:21.272384 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914a4800 :6790 s=STATE_OPEN pgs=124 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.526848 I | rook-ceph-mon0: -414> 2018-04-17 04:35:21.272397 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914a4800 :6790 s=STATE_OPEN pgs=124 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.526874 I | rook-ceph-mon0: -413> 2018-04-17 04:35:21.272411 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914a4800 :6790 s=STATE_OPEN pgs=124 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.526892 I | rook-ceph-mon0: -412> 2018-04-17 04:35:21.272429 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914a4800 :6790 s=STATE_OPEN pgs=124 cs=1 l=1)._stop
- 2018-04-17 04:35:27.526909 I | rook-ceph-mon0: -411> 2018-04-17 04:35:21.273043 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d391500000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=34 -
- 2018-04-17 04:35:27.526927 I | rook-ceph-mon0: -410> 2018-04-17 04:35:21.273767 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391500000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=125 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.526945 I | rook-ceph-mon0: -409> 2018-04-17 04:35:21.274221 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391500000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=125 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.526966 I | rook-ceph-mon0: -408> 2018-04-17 04:35:21.274447 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391500000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=125 cs=1 l=1). rx client.? seq 1 0x55d3914b8800 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.526985 I | rook-ceph-mon0: -407> 2018-04-17 04:35:21.274528 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.59.0:0/1209919990 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b8800 con 0x55d391500000
- 2018-04-17 04:35:27.527003 I | rook-ceph-mon0: -406> 2018-04-17 04:35:21.555775 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d3914c2000 :6790 s=STATE_OPEN pgs=135 cs=1 l=1).read_bulk peer close file descriptor 37
- 2018-04-17 04:35:27.527025 I | rook-ceph-mon0: -405> 2018-04-17 04:35:21.555820 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d3914c2000 :6790 s=STATE_OPEN pgs=135 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.527045 I | rook-ceph-mon0: -404> 2018-04-17 04:35:21.555830 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d3914c2000 :6790 s=STATE_OPEN pgs=135 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.527064 I | rook-ceph-mon0: -403> 2018-04-17 04:35:21.555838 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d3914c2000 :6790 s=STATE_OPEN pgs=135 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.527080 I | rook-ceph-mon0: -402> 2018-04-17 04:35:21.555845 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d3914c2000 :6790 s=STATE_OPEN pgs=135 cs=1 l=1)._stop
- 2018-04-17 04:35:27.527098 I | rook-ceph-mon0: -401> 2018-04-17 04:35:21.741026 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d3914c3800 :6790 s=STATE_OPEN pgs=178 cs=1 l=1).read_bulk peer close file descriptor 38
- 2018-04-17 04:35:27.527116 I | rook-ceph-mon0: -400> 2018-04-17 04:35:21.741087 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d3914c3800 :6790 s=STATE_OPEN pgs=178 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.527134 I | rook-ceph-mon0: -399> 2018-04-17 04:35:21.741118 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d3914c3800 :6790 s=STATE_OPEN pgs=178 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.527168 I | rook-ceph-mon0: -398> 2018-04-17 04:35:21.741133 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d3914c3800 :6790 s=STATE_OPEN pgs=178 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.527191 I | rook-ceph-mon0: -397> 2018-04-17 04:35:21.741145 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d3914c3800 :6790 s=STATE_OPEN pgs=178 cs=1 l=1)._stop
- 2018-04-17 04:35:27.527215 I | rook-ceph-mon0: -396> 2018-04-17 04:35:21.741723 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d391501800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=35 -
- 2018-04-17 04:35:27.527236 I | rook-ceph-mon0: -395> 2018-04-17 04:35:21.742565 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391501800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=180 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.527255 I | rook-ceph-mon0: -394> 2018-04-17 04:35:21.742937 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391501800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=180 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.527273 I | rook-ceph-mon0: -393> 2018-04-17 04:35:21.743215 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391501800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=180 cs=1 l=1). rx client.? seq 1 0x55d3914b8a80 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.527291 I | rook-ceph-mon0: -392> 2018-04-17 04:35:21.743303 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.249.1:0/2662115732 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b8a80 con 0x55d391501800
- 2018-04-17 04:35:27.527309 I | rook-ceph-mon0: -391> 2018-04-17 04:35:21.871336 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d3914c5000 :6790 s=STATE_OPEN pgs=350 cs=1 l=1).read_bulk peer close file descriptor 39
- 2018-04-17 04:35:27.527326 I | rook-ceph-mon0: -390> 2018-04-17 04:35:21.871370 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d3914c5000 :6790 s=STATE_OPEN pgs=350 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.527345 I | rook-ceph-mon0: -389> 2018-04-17 04:35:21.871378 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d3914c5000 :6790 s=STATE_OPEN pgs=350 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.527363 I | rook-ceph-mon0: -388> 2018-04-17 04:35:21.871387 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d3914c5000 :6790 s=STATE_OPEN pgs=350 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.527381 I | rook-ceph-mon0: -387> 2018-04-17 04:35:21.871394 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d3914c5000 :6790 s=STATE_OPEN pgs=350 cs=1 l=1)._stop
- 2018-04-17 04:35:27.527400 I | rook-ceph-mon0: -386> 2018-04-17 04:35:21.872227 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d391503000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=36 -
- 2018-04-17 04:35:27.527420 I | rook-ceph-mon0: -385> 2018-04-17 04:35:21.872996 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391503000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=353 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.527434 I | rook-ceph-mon0: -384> 2018-04-17 04:35:21.873398 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391503000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=353 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.527446 I | rook-ceph-mon0: -383> 2018-04-17 04:35:21.873580 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391503000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=353 cs=1 l=1). rx osd.0 seq 1 0x55d3914b8080 auth(proto 0 26 bytes epoch 0) v1
- 2018-04-17 04:35:27.527458 I | rook-ceph-mon0: -382> 2018-04-17 04:35:21.873653 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== osd.0 192.168.108.184:6800/29 1 ==== auth(proto 0 26 bytes epoch 0) v1 ==== 56+0+0 (3942267087 0 0) 0x55d3914b8080 con 0x55d391503000
- 2018-04-17 04:35:27.527472 I | rook-ceph-mon0: -381> 2018-04-17 04:35:21.938441 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d3914c6800 :6790 s=STATE_OPEN pgs=179 cs=1 l=1).read_bulk peer close file descriptor 40
- 2018-04-17 04:35:27.527484 I | rook-ceph-mon0: -380> 2018-04-17 04:35:21.938471 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d3914c6800 :6790 s=STATE_OPEN pgs=179 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.527496 I | rook-ceph-mon0: -379> 2018-04-17 04:35:21.938513 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d3914c6800 :6790 s=STATE_OPEN pgs=179 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.527528 I | rook-ceph-mon0: -378> 2018-04-17 04:35:21.938523 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d3914c6800 :6790 s=STATE_OPEN pgs=179 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.527549 I | rook-ceph-mon0: -377> 2018-04-17 04:35:21.938529 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d3914c6800 :6790 s=STATE_OPEN pgs=179 cs=1 l=1)._stop
- 2018-04-17 04:35:27.527567 I | rook-ceph-mon0: -376> 2018-04-17 04:35:21.938860 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d391504800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=37 -
- 2018-04-17 04:35:27.527585 I | rook-ceph-mon0: -375> 2018-04-17 04:35:21.939265 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d391504800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=180 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.527602 I | rook-ceph-mon0: -374> 2018-04-17 04:35:21.939386 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d391504800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=180 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.527625 I | rook-ceph-mon0: -373> 2018-04-17 04:35:21.939571 7f382c568700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d391504800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=180 cs=1 l=1). rx client.? seq 1 0x55d3914b8f80 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.527643 I | rook-ceph-mon0: -372> 2018-04-17 04:35:21.939646 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.33.0:0/823466689 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b8f80 con 0x55d391504800
- 2018-04-17 04:35:27.527663 I | rook-ceph-mon0: -371> 2018-04-17 04:35:22.099873 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d3914d5800 :6790 s=STATE_OPEN pgs=3 cs=1 l=1).read_bulk peer close file descriptor 42
- 2018-04-17 04:35:27.527705 I | rook-ceph-mon0: -370> 2018-04-17 04:35:22.099912 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d3914d5800 :6790 s=STATE_OPEN pgs=3 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.527728 I | rook-ceph-mon0: -369> 2018-04-17 04:35:22.099922 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d3914d5800 :6790 s=STATE_OPEN pgs=3 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.527743 I | rook-ceph-mon0: -368> 2018-04-17 04:35:22.099931 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d3914d5800 :6790 s=STATE_OPEN pgs=3 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.527755 I | rook-ceph-mon0: -367> 2018-04-17 04:35:22.099961 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d3914d5800 :6790 s=STATE_OPEN pgs=3 cs=1 l=1)._stop
- 2018-04-17 04:35:27.527780 I | rook-ceph-mon0: -366> 2018-04-17 04:35:22.100084 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/726206361 conn(0x55d3914d4000 :6790 s=STATE_OPEN pgs=3 cs=1 l=1).read_bulk peer close file descriptor 41
- 2018-04-17 04:35:27.527800 I | rook-ceph-mon0: -365> 2018-04-17 04:35:22.100134 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/726206361 conn(0x55d3914d4000 :6790 s=STATE_OPEN pgs=3 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.527827 I | rook-ceph-mon0: -364> 2018-04-17 04:35:22.100144 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/726206361 conn(0x55d3914d4000 :6790 s=STATE_OPEN pgs=3 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.527848 I | rook-ceph-mon0: -363> 2018-04-17 04:35:22.100153 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/726206361 conn(0x55d3914d4000 :6790 s=STATE_OPEN pgs=3 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.527877 I | rook-ceph-mon0: -362> 2018-04-17 04:35:22.100160 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/726206361 conn(0x55d3914d4000 :6790 s=STATE_OPEN pgs=3 cs=1 l=1)._stop
- 2018-04-17 04:35:27.527896 I | rook-ceph-mon0: -361> 2018-04-17 04:35:22.100194 7f382bd67700 1 -- 10.107.181.203:6790/0 reap_dead start
- 2018-04-17 04:35:27.527914 I | rook-ceph-mon0: -360> 2018-04-17 04:35:22.100229 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d3914a1800
- 2018-04-17 04:35:27.527942 I | rook-ceph-mon0: -359> 2018-04-17 04:35:22.100240 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d3914a3000
- 2018-04-17 04:35:27.527959 I | rook-ceph-mon0: -358> 2018-04-17 04:35:22.100306 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d3914c2000
- 2018-04-17 04:35:27.527977 I | rook-ceph-mon0: -357> 2018-04-17 04:35:22.100325 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d3914d4000
- 2018-04-17 04:35:27.527995 I | rook-ceph-mon0: -356> 2018-04-17 04:35:22.100331 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d3914d5800
- 2018-04-17 04:35:27.528029 I | rook-ceph-mon0: -355> 2018-04-17 04:35:22.436632 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d39151e000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=38 -
- 2018-04-17 04:35:27.528049 I | rook-ceph-mon0: -354> 2018-04-17 04:35:22.437210 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39151e000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=699 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.528067 I | rook-ceph-mon0: -353> 2018-04-17 04:35:22.437371 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39151e000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=699 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.528088 I | rook-ceph-mon0: -352> 2018-04-17 04:35:22.437526 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39151e000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=699 cs=1 l=1). rx osd.2 seq 1 0x55d3914b8300 auth(proto 0 26 bytes epoch 0) v1
- 2018-04-17 04:35:27.528107 I | rook-ceph-mon0: -351> 2018-04-17 04:35:22.437613 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== osd.2 192.168.33.56:6800/4939 1 ==== auth(proto 0 26 bytes epoch 0) v1 ==== 56+0+0 (2338211845 0 0) 0x55d3914b8300 con 0x55d39151e000
- 2018-04-17 04:35:27.528136 I | rook-ceph-mon0: -350> 2018-04-17 04:35:22.488770 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488775 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528157 I | rook-ceph-mon0: -349> 2018-04-17 04:35:22.488808 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488811 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528175 I | rook-ceph-mon0: -348> 2018-04-17 04:35:22.488825 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488827 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528197 I | rook-ceph-mon0: -347> 2018-04-17 04:35:22.488837 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488839 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528215 I | rook-ceph-mon0: -346> 2018-04-17 04:35:22.488852 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488854 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528233 I | rook-ceph-mon0: -345> 2018-04-17 04:35:22.488863 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488865 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528252 I | rook-ceph-mon0: -344> 2018-04-17 04:35:22.488885 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488888 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528271 I | rook-ceph-mon0: -343> 2018-04-17 04:35:22.488903 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488905 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528288 I | rook-ceph-mon0: -342> 2018-04-17 04:35:22.488926 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488929 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528306 I | rook-ceph-mon0: -341> 2018-04-17 04:35:22.488944 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488946 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528324 I | rook-ceph-mon0: -340> 2018-04-17 04:35:22.488965 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488968 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528342 I | rook-ceph-mon0: -339> 2018-04-17 04:35:22.488977 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488979 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528362 I | rook-ceph-mon0: -338> 2018-04-17 04:35:22.488992 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.488994 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528380 I | rook-ceph-mon0: -337> 2018-04-17 04:35:22.489009 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.489011 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528416 I | rook-ceph-mon0: -336> 2018-04-17 04:35:22.489024 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.489026 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528440 I | rook-ceph-mon0: -335> 2018-04-17 04:35:22.489042 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.489044 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528464 I | rook-ceph-mon0: -334> 2018-04-17 04:35:22.489058 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.489060 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528483 I | rook-ceph-mon0: -333> 2018-04-17 04:35:22.489078 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.489080 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528501 I | rook-ceph-mon0: -332> 2018-04-17 04:35:22.489093 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.489095 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528519 I | rook-ceph-mon0: -331> 2018-04-17 04:35:22.489104 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.489106 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528536 I | rook-ceph-mon0: -330> 2018-04-17 04:35:22.489118 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.489120 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528554 I | rook-ceph-mon0: -329> 2018-04-17 04:35:22.489131 7f3832574700 5 mon.rook-ceph-mon0@1(electing).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:22.489133 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.528572 I | rook-ceph-mon0: -328> 2018-04-17 04:35:22.498546 7f382c568700 1 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d3914d7000 :6790 s=STATE_OPEN pgs=75 cs=1 l=1).read_bulk peer close file descriptor 43
- 2018-04-17 04:35:27.528591 I | rook-ceph-mon0: -327> 2018-04-17 04:35:22.498580 7f382c568700 1 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d3914d7000 :6790 s=STATE_OPEN pgs=75 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.528611 I | rook-ceph-mon0: -326> 2018-04-17 04:35:22.498590 7f382c568700 1 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d3914d7000 :6790 s=STATE_OPEN pgs=75 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.528629 I | rook-ceph-mon0: -325> 2018-04-17 04:35:22.498598 7f382c568700 1 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d3914d7000 :6790 s=STATE_OPEN pgs=75 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.528657 I | rook-ceph-mon0: -324> 2018-04-17 04:35:22.498605 7f382c568700 2 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d3914d7000 :6790 s=STATE_OPEN pgs=75 cs=1 l=1)._stop
- 2018-04-17 04:35:27.528698 I | rook-ceph-mon0: -323> 2018-04-17 04:35:22.499405 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d39151f800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=39 -
- 2018-04-17 04:35:27.528724 I | rook-ceph-mon0: -322> 2018-04-17 04:35:22.500237 7f382c568700 2 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39151f800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=77 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.528744 I | rook-ceph-mon0: -321> 2018-04-17 04:35:22.500622 7f382c568700 2 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39151f800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=77 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.528764 I | rook-ceph-mon0: -320> 2018-04-17 04:35:22.500796 7f382c568700 5 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39151f800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=77 cs=1 l=1). rx client.? seq 1 0x55d3914b9200 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.528783 I | rook-ceph-mon0: -319> 2018-04-17 04:35:22.501184 7f3832574700 1 -- 10.107.181.203:6790/0 _send_message--> mon.0 10.97.51.86:6790/0 -- election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 propose 959) v7 -- ?+0 0x55d3912f1380
- 2018-04-17 04:35:27.528810 I | rook-ceph-mon0: -318> 2018-04-17 04:35:22.501227 7f3832574700 1 -- 10.107.181.203:6790/0 --> 10.97.51.86:6790/0 -- election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 propose 959) v7 -- 0x55d3912f1380 con 0
- 2018-04-17 04:35:27.528828 I | rook-ceph-mon0: -317> 2018-04-17 04:35:22.501292 7f3832574700 1 -- 10.107.181.203:6790/0 _send_message--> mon.2 10.111.191.96:6790/0 -- election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 propose 959) v7 -- ?+0 0x55d3912f16c0
- 2018-04-17 04:35:27.528863 I | rook-ceph-mon0: -316> 2018-04-17 04:35:22.501332 7f3832574700 1 -- 10.107.181.203:6790/0 --> 10.111.191.96:6790/0 -- election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 propose 959) v7 -- 0x55d3912f16c0 con 0
- 2018-04-17 04:35:27.528883 I | rook-ceph-mon0: -315> 2018-04-17 04:35:22.501444 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 199.96.132.12:0/2329353454 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b9200 con 0x55d39151f800
- 2018-04-17 04:35:27.528902 I | rook-ceph-mon0: -314> 2018-04-17 04:35:22.504390 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240644 0x55d3912f16c0 election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 ack 959) v7
- 2018-04-17 04:35:27.528920 I | rook-ceph-mon0: -313> 2018-04-17 04:35:22.504469 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240644 ==== election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 ack 959) v7 ==== 40009+0+0 (4268821475 0 0) 0x55d3912f16c0 con 0x55d39147a800
- 2018-04-17 04:35:27.528940 I | rook-ceph-mon0: -312> 2018-04-17 04:35:22.539057 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d3914d8800 :6790 s=STATE_OPEN pgs=80 cs=1 l=1).read_bulk peer close file descriptor 44
- 2018-04-17 04:35:27.528958 I | rook-ceph-mon0: -311> 2018-04-17 04:35:22.539086 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d3914d8800 :6790 s=STATE_OPEN pgs=80 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.529002 I | rook-ceph-mon0: -310> 2018-04-17 04:35:22.539100 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d3914d8800 :6790 s=STATE_OPEN pgs=80 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.529022 I | rook-ceph-mon0: -309> 2018-04-17 04:35:22.539114 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d3914d8800 :6790 s=STATE_OPEN pgs=80 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.529039 I | rook-ceph-mon0: -308> 2018-04-17 04:35:22.539128 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d3914d8800 :6790 s=STATE_OPEN pgs=80 cs=1 l=1)._stop
- 2018-04-17 04:35:27.529057 I | rook-ceph-mon0: -307> 2018-04-17 04:35:22.539644 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d391521000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=40 -
- 2018-04-17 04:35:27.529075 I | rook-ceph-mon0: -306> 2018-04-17 04:35:22.540110 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391521000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=83 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.529092 I | rook-ceph-mon0: -305> 2018-04-17 04:35:22.540245 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391521000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=83 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.529113 I | rook-ceph-mon0: -304> 2018-04-17 04:35:22.540432 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391521000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=83 cs=1 l=1). rx client.? seq 1 0x55d3914b8d00 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.529131 I | rook-ceph-mon0: -303> 2018-04-17 04:35:22.540524 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.33.0:0/2502043250 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b8d00 con 0x55d391521000
- 2018-04-17 04:35:27.529148 I | rook-ceph-mon0: -302> 2018-04-17 04:35:22.773182 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d3914ee000 :6790 s=STATE_OPEN pgs=80 cs=1 l=1).read_bulk peer close file descriptor 45
- 2018-04-17 04:35:27.529165 I | rook-ceph-mon0: -301> 2018-04-17 04:35:22.773228 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d3914ee000 :6790 s=STATE_OPEN pgs=80 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.529182 I | rook-ceph-mon0: -300> 2018-04-17 04:35:22.773238 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d3914ee000 :6790 s=STATE_OPEN pgs=80 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.529198 I | rook-ceph-mon0: -299> 2018-04-17 04:35:22.773246 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d3914ee000 :6790 s=STATE_OPEN pgs=80 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.529215 I | rook-ceph-mon0: -298> 2018-04-17 04:35:22.773252 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d3914ee000 :6790 s=STATE_OPEN pgs=80 cs=1 l=1)._stop
- 2018-04-17 04:35:27.529232 I | rook-ceph-mon0: -297> 2018-04-17 04:35:22.774071 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d391522800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=41 -
- 2018-04-17 04:35:27.529257 I | rook-ceph-mon0: -296> 2018-04-17 04:35:22.774841 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d391522800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=83 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.529416 I | rook-ceph-mon0: -295> 2018-04-17 04:35:22.775247 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d391522800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=83 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.529445 I | rook-ceph-mon0: -294> 2018-04-17 04:35:22.775371 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d391522800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=83 cs=1 l=1). rx client.? seq 1 0x55d3914b7180 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.529464 I | rook-ceph-mon0: -293> 2018-04-17 04:35:22.775447 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.249.1:0/2144414442 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b7180 con 0x55d391522800
- 2018-04-17 04:35:27.529487 I | rook-ceph-mon0: -292> 2018-04-17 04:35:22.839766 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914f1000 :6790 s=STATE_OPEN pgs=136 cs=1 l=1).read_bulk peer close file descriptor 47
- 2018-04-17 04:35:27.529506 I | rook-ceph-mon0: -291> 2018-04-17 04:35:22.839797 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914f1000 :6790 s=STATE_OPEN pgs=136 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.529525 I | rook-ceph-mon0: -290> 2018-04-17 04:35:22.839808 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914f1000 :6790 s=STATE_OPEN pgs=136 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.529542 I | rook-ceph-mon0: -289> 2018-04-17 04:35:22.839815 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914f1000 :6790 s=STATE_OPEN pgs=136 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.529558 I | rook-ceph-mon0: -288> 2018-04-17 04:35:22.839822 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914f1000 :6790 s=STATE_OPEN pgs=136 cs=1 l=1)._stop
- 2018-04-17 04:35:27.529578 I | rook-ceph-mon0: -287> 2018-04-17 04:35:22.840563 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914a4800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=42 -
- 2018-04-17 04:35:27.529596 I | rook-ceph-mon0: -286> 2018-04-17 04:35:22.841353 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914a4800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=138 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.529614 I | rook-ceph-mon0: -285> 2018-04-17 04:35:22.841841 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914a4800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=138 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.529634 I | rook-ceph-mon0: -284> 2018-04-17 04:35:22.841913 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914a4800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=138 cs=1 l=1). rx client.? seq 1 0x55d3914b7400 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.529657 I | rook-ceph-mon0: -283> 2018-04-17 04:35:22.842003 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.249.1:0/3332407889 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b7400 con 0x55d3914a4800
- 2018-04-17 04:35:27.529700 I | rook-ceph-mon0: -282> 2018-04-17 04:35:22.846189 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2457710081 conn(0x55d3914ef800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).read_bulk peer close file descriptor 46
- 2018-04-17 04:35:27.529970 I | rook-ceph-mon0: -281> 2018-04-17 04:35:22.846218 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2457710081 conn(0x55d3914ef800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.530012 I | rook-ceph-mon0: -280> 2018-04-17 04:35:22.846226 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2457710081 conn(0x55d3914ef800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.530042 I | rook-ceph-mon0: -279> 2018-04-17 04:35:22.846234 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2457710081 conn(0x55d3914ef800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.530063 I | rook-ceph-mon0: -278> 2018-04-17 04:35:22.846241 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2457710081 conn(0x55d3914ef800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1)._stop
- 2018-04-17 04:35:27.530082 I | rook-ceph-mon0: -277> 2018-04-17 04:35:22.846878 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914a1800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=43 -
- 2018-04-17 04:35:27.530116 I | rook-ceph-mon0: -276> 2018-04-17 04:35:22.847482 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/1687677576 conn(0x55d3914a1800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=4 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.530145 I | rook-ceph-mon0: -275> 2018-04-17 04:35:22.847867 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/1687677576 conn(0x55d3914a1800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=4 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.530165 I | rook-ceph-mon0: -274> 2018-04-17 04:35:22.847976 7f382c568700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/1687677576 conn(0x55d3914a1800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=4 cs=1 l=1). rx unknown.0 seq 1 0x55d3914b9480 auth(proto 0 34 bytes epoch 0)
- 2018-04-17 04:35:27.530184 I | rook-ceph-mon0: -273> 2018-04-17 04:35:22.848040 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== unknown.0 192.168.249.1:0/1687677576 1 ==== auth(proto 0 34 bytes epoch 0) ==== 60+0+0 (3679117932 0 0) 0x55d3914b9480 con 0x55d3914a1800
- 2018-04-17 04:35:27.530205 I | rook-ceph-mon0: -272> 2018-04-17 04:35:23.123984 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d3914f2800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).read_bulk peer close file descriptor 48
- 2018-04-17 04:35:27.530224 I | rook-ceph-mon0: -271> 2018-04-17 04:35:23.124029 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d3914f2800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.530250 I | rook-ceph-mon0: -270> 2018-04-17 04:35:23.124038 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d3914f2800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.530269 I | rook-ceph-mon0: -269> 2018-04-17 04:35:23.124046 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d3914f2800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.530288 I | rook-ceph-mon0: -268> 2018-04-17 04:35:23.124053 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d3914f2800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1)._stop
- 2018-04-17 04:35:27.530307 I | rook-ceph-mon0: -267> 2018-04-17 04:35:23.124215 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914a3000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=44 -
- 2018-04-17 04:35:27.530333 I | rook-ceph-mon0: -266> 2018-04-17 04:35:23.124502 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a3000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=5 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.530353 I | rook-ceph-mon0: -265> 2018-04-17 04:35:23.124767 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a3000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=5 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.530382 I | rook-ceph-mon0: -264> 2018-04-17 04:35:23.124853 7f382c568700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a3000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=5 cs=1 l=1). rx unknown.0 seq 1 0x55d3914b9700 auth(proto 0 34 bytes epoch 0)
- 2018-04-17 04:35:27.530401 I | rook-ceph-mon0: -263> 2018-04-17 04:35:23.124997 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== unknown.0 192.168.33.0:0/1017577090 1 ==== auth(proto 0 34 bytes epoch 0) ==== 60+0+0 (3679117932 0 0) 0x55d3914b9700 con 0x55d3914a3000
- 2018-04-17 04:35:27.530426 I | rook-ceph-mon0: -262> 2018-04-17 04:35:24.165195 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914d4000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=45 -
- 2018-04-17 04:35:27.530452 I | rook-ceph-mon0: -261> 2018-04-17 04:35:24.166039 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914d4000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=553 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.530485 I | rook-ceph-mon0: -260> 2018-04-17 04:35:24.166494 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914d4000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=553 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.530505 I | rook-ceph-mon0: -259> 2018-04-17 04:35:24.166612 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914d4000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=553 cs=1 l=1). rx client.? seq 1 0x55d3914b6780 auth(proto 0 39 bytes epoch 0) v1
- 2018-04-17 04:35:27.530529 I | rook-ceph-mon0: -258> 2018-04-17 04:35:24.166691 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.249.1:0/2171750696 1 ==== auth(proto 0 39 bytes epoch 0) v1 ==== 69+0+0 (914456824 0 0) 0x55d3914b6780 con 0x55d3914d4000
- 2018-04-17 04:35:27.530561 I | rook-ceph-mon0: -257> 2018-04-17 04:35:24.272870 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391500000 :6790 s=STATE_OPEN pgs=125 cs=1 l=1).read_bulk peer close file descriptor 34
- 2018-04-17 04:35:27.530588 I | rook-ceph-mon0: -256> 2018-04-17 04:35:24.272904 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391500000 :6790 s=STATE_OPEN pgs=125 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.530608 I | rook-ceph-mon0: -255> 2018-04-17 04:35:24.273015 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391500000 :6790 s=STATE_OPEN pgs=125 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.530626 I | rook-ceph-mon0: -254> 2018-04-17 04:35:24.273043 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391500000 :6790 s=STATE_OPEN pgs=125 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.530650 I | rook-ceph-mon0: -253> 2018-04-17 04:35:24.273051 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391500000 :6790 s=STATE_OPEN pgs=125 cs=1 l=1)._stop
- 2018-04-17 04:35:27.530669 I | rook-ceph-mon0: -252> 2018-04-17 04:35:24.273895 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d3914d5800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=34 -
- 2018-04-17 04:35:27.530823 I | rook-ceph-mon0: -251> 2018-04-17 04:35:24.274811 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914d5800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=128 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.530851 I | rook-ceph-mon0: -250> 2018-04-17 04:35:24.275599 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914d5800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=128 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.530871 I | rook-ceph-mon0: -249> 2018-04-17 04:35:24.275707 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914d5800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=128 cs=1 l=1). rx client.? seq 1 0x55d3914b6280 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.530891 I | rook-ceph-mon0: -248> 2018-04-17 04:35:24.275783 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.59.0:0/1209919990 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b6280 con 0x55d3914d5800
- 2018-04-17 04:35:27.530911 I | rook-ceph-mon0: -247> 2018-04-17 04:35:24.556486 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d391536000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=46 -
- 2018-04-17 04:35:27.530937 I | rook-ceph-mon0: -246> 2018-04-17 04:35:24.556976 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d391536000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=140 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.530956 I | rook-ceph-mon0: -245> 2018-04-17 04:35:24.557073 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d391536000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=140 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.530987 I | rook-ceph-mon0: -244> 2018-04-17 04:35:24.557292 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d391536000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=140 cs=1 l=1). rx client.? seq 1 0x55d3914b6c80 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.531006 I | rook-ceph-mon0: -243> 2018-04-17 04:35:24.557391 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.33.0:0/3926288723 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b6c80 con 0x55d391536000
- 2018-04-17 04:35:27.531032 I | rook-ceph-mon0: -242> 2018-04-17 04:35:24.741432 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391501800 :6790 s=STATE_OPEN pgs=180 cs=1 l=1).read_bulk peer close file descriptor 35
- 2018-04-17 04:35:27.531055 I | rook-ceph-mon0: -241> 2018-04-17 04:35:24.741481 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391501800 :6790 s=STATE_OPEN pgs=180 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.531077 I | rook-ceph-mon0: -240> 2018-04-17 04:35:24.741490 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391501800 :6790 s=STATE_OPEN pgs=180 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.531105 I | rook-ceph-mon0: -239> 2018-04-17 04:35:24.741500 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391501800 :6790 s=STATE_OPEN pgs=180 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.531124 I | rook-ceph-mon0: -238> 2018-04-17 04:35:24.741507 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391501800 :6790 s=STATE_OPEN pgs=180 cs=1 l=1)._stop
- 2018-04-17 04:35:27.531162 I | rook-ceph-mon0: -237> 2018-04-17 04:35:24.742082 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d391537800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=35 -
- 2018-04-17 04:35:27.531190 I | rook-ceph-mon0: -236> 2018-04-17 04:35:24.742667 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391537800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=183 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.531209 I | rook-ceph-mon0: -235> 2018-04-17 04:35:24.742987 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391537800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=183 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.531227 I | rook-ceph-mon0: -234> 2018-04-17 04:35:24.743097 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391537800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=183 cs=1 l=1). rx client.? seq 1 0x55d3914b6500 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.531256 I | rook-ceph-mon0: -233> 2018-04-17 04:35:24.743194 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.249.1:0/2662115732 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b6500 con 0x55d391537800
- 2018-04-17 04:35:27.531276 I | rook-ceph-mon0: -232> 2018-04-17 04:35:24.871848 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391503000 :6790 s=STATE_OPEN pgs=353 cs=1 l=1).read_bulk peer close file descriptor 36
- 2018-04-17 04:35:27.531298 I | rook-ceph-mon0: -231> 2018-04-17 04:35:24.871912 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391503000 :6790 s=STATE_OPEN pgs=353 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.531318 I | rook-ceph-mon0: -230> 2018-04-17 04:35:24.871925 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391503000 :6790 s=STATE_OPEN pgs=353 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.531350 I | rook-ceph-mon0: -229> 2018-04-17 04:35:24.871934 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391503000 :6790 s=STATE_OPEN pgs=353 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.531369 I | rook-ceph-mon0: -228> 2018-04-17 04:35:24.871941 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391503000 :6790 s=STATE_OPEN pgs=353 cs=1 l=1)._stop
- 2018-04-17 04:35:27.531387 I | rook-ceph-mon0: -227> 2018-04-17 04:35:24.872795 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d391539000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=36 -
- 2018-04-17 04:35:27.531414 I | rook-ceph-mon0: -226> 2018-04-17 04:35:24.873504 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391539000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=355 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.531433 I | rook-ceph-mon0: -225> 2018-04-17 04:35:24.873863 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391539000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=355 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.531462 I | rook-ceph-mon0: -224> 2018-04-17 04:35:24.874103 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391539000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=355 cs=1 l=1). rx osd.0 seq 1 0x55d390eb9c00 auth(proto 0 26 bytes epoch 0) v1
- 2018-04-17 04:35:27.531484 I | rook-ceph-mon0: -223> 2018-04-17 04:35:24.874183 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== osd.0 192.168.108.184:6800/29 1 ==== auth(proto 0 26 bytes epoch 0) v1 ==== 56+0+0 (3942267087 0 0) 0x55d390eb9c00 con 0x55d391539000
- 2018-04-17 04:35:27.531510 I | rook-ceph-mon0: -222> 2018-04-17 04:35:24.938926 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d391504800 :6790 s=STATE_OPEN pgs=180 cs=1 l=1).read_bulk peer close file descriptor 37
- 2018-04-17 04:35:27.531528 I | rook-ceph-mon0: -221> 2018-04-17 04:35:24.938962 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d391504800 :6790 s=STATE_OPEN pgs=180 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.531554 I | rook-ceph-mon0: -220> 2018-04-17 04:35:24.938972 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d391504800 :6790 s=STATE_OPEN pgs=180 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.531578 I | rook-ceph-mon0: -219> 2018-04-17 04:35:24.938998 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d391504800 :6790 s=STATE_OPEN pgs=180 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.531603 I | rook-ceph-mon0: -218> 2018-04-17 04:35:24.939006 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d391504800 :6790 s=STATE_OPEN pgs=180 cs=1 l=1)._stop
- 2018-04-17 04:35:27.531636 I | rook-ceph-mon0: -217> 2018-04-17 04:35:24.939306 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d39153a800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=37 -
- 2018-04-17 04:35:27.531664 I | rook-ceph-mon0: -216> 2018-04-17 04:35:24.939780 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d39153a800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=182 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.531719 I | rook-ceph-mon0: -215> 2018-04-17 04:35:24.939935 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d39153a800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=182 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.531745 I | rook-ceph-mon0: -214> 2018-04-17 04:35:24.940116 7f382c568700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d39153a800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=182 cs=1 l=1). rx client.? seq 1 0x55d3914b9980 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.531763 I | rook-ceph-mon0: -213> 2018-04-17 04:35:24.940197 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.33.0:0/823466689 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b9980 con 0x55d39153a800
- 2018-04-17 04:35:27.531781 I | rook-ceph-mon0: -212> 2018-04-17 04:35:25.108313 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d39154c000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=47 -
- 2018-04-17 04:35:27.531805 I | rook-ceph-mon0: -211> 2018-04-17 04:35:25.108738 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d39154c000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=5 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.531823 I | rook-ceph-mon0: -210> 2018-04-17 04:35:25.108966 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d39154c000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=5 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.531850 I | rook-ceph-mon0: -209> 2018-04-17 04:35:25.109116 7f382c568700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d39154c000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=5 cs=1 l=1). rx unknown.0 seq 1 0x55d3914b9c00 auth(proto 0 34 bytes epoch 0)
- 2018-04-17 04:35:27.531870 I | rook-ceph-mon0: -208> 2018-04-17 04:35:25.109209 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== unknown.0 192.168.33.0:0/3111804194 1 ==== auth(proto 0 34 bytes epoch 0) ==== 60+0+0 (3679117932 0 0) 0x55d3914b9c00 con 0x55d39154c000
- 2018-04-17 04:35:27.531893 I | rook-ceph-mon0: -207> 2018-04-17 04:35:25.436671 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39151e000 :6790 s=STATE_OPEN pgs=699 cs=1 l=1).read_bulk peer close file descriptor 38
- 2018-04-17 04:35:27.531923 I | rook-ceph-mon0: -206> 2018-04-17 04:35:25.436713 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39151e000 :6790 s=STATE_OPEN pgs=699 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.531943 I | rook-ceph-mon0: -205> 2018-04-17 04:35:25.436722 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39151e000 :6790 s=STATE_OPEN pgs=699 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.531962 I | rook-ceph-mon0: -204> 2018-04-17 04:35:25.436730 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39151e000 :6790 s=STATE_OPEN pgs=699 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.531995 I | rook-ceph-mon0: -203> 2018-04-17 04:35:25.436762 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39151e000 :6790 s=STATE_OPEN pgs=699 cs=1 l=1)._stop
- 2018-04-17 04:35:27.532014 I | rook-ceph-mon0: -202> 2018-04-17 04:35:25.437131 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d39154d800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=38 -
- 2018-04-17 04:35:27.532040 I | rook-ceph-mon0: -201> 2018-04-17 04:35:25.437571 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39154d800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=701 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.532069 I | rook-ceph-mon0: -200> 2018-04-17 04:35:25.437758 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39154d800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=701 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.532094 I | rook-ceph-mon0: -199> 2018-04-17 04:35:25.437998 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39154d800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=701 cs=1 l=1). rx osd.2 seq 1 0x55d39155e000 auth(proto 0 26 bytes epoch 0) v1
- 2018-04-17 04:35:27.532124 I | rook-ceph-mon0: -198> 2018-04-17 04:35:25.438092 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== osd.2 192.168.33.56:6800/4939 1 ==== auth(proto 0 26 bytes epoch 0) v1 ==== 56+0+0 (2338211845 0 0) 0x55d39155e000 con 0x55d39154d800
- 2018-04-17 04:35:27.532152 I | rook-ceph-mon0: -197> 2018-04-17 04:35:25.499012 7f382c568700 1 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39151f800 :6790 s=STATE_OPEN pgs=77 cs=1 l=1).read_bulk peer close file descriptor 39
- 2018-04-17 04:35:27.532171 I | rook-ceph-mon0: -196> 2018-04-17 04:35:25.499046 7f382c568700 1 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39151f800 :6790 s=STATE_OPEN pgs=77 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.532194 I | rook-ceph-mon0: -195> 2018-04-17 04:35:25.499055 7f382c568700 1 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39151f800 :6790 s=STATE_OPEN pgs=77 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.532224 I | rook-ceph-mon0: -194> 2018-04-17 04:35:25.499063 7f382c568700 1 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39151f800 :6790 s=STATE_OPEN pgs=77 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.532243 I | rook-ceph-mon0: -193> 2018-04-17 04:35:25.499106 7f382c568700 2 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39151f800 :6790 s=STATE_OPEN pgs=77 cs=1 l=1)._stop
- 2018-04-17 04:35:27.532262 I | rook-ceph-mon0: -192> 2018-04-17 04:35:25.499727 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d39154f000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=39 -
- 2018-04-17 04:35:27.532297 I | rook-ceph-mon0: -191> 2018-04-17 04:35:25.500448 7f382c568700 2 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39154f000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=78 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.532316 I | rook-ceph-mon0: -190> 2018-04-17 04:35:25.500775 7f382c568700 2 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39154f000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=78 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.532341 I | rook-ceph-mon0: -189> 2018-04-17 04:35:25.500899 7f382c568700 5 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39154f000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=78 cs=1 l=1). rx client.? seq 1 0x55d39155ec80 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.532372 I | rook-ceph-mon0: -188> 2018-04-17 04:35:25.500970 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 199.96.132.12:0/2329353454 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d39155ec80 con 0x55d39154f000
- 2018-04-17 04:35:27.532397 I | rook-ceph-mon0: -187> 2018-04-17 04:35:25.539561 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391521000 :6790 s=STATE_OPEN pgs=83 cs=1 l=1).read_bulk peer close file descriptor 40
- 2018-04-17 04:35:27.532417 I | rook-ceph-mon0: -186> 2018-04-17 04:35:25.539602 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391521000 :6790 s=STATE_OPEN pgs=83 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.532434 I | rook-ceph-mon0: -185> 2018-04-17 04:35:25.539614 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391521000 :6790 s=STATE_OPEN pgs=83 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.532455 I | rook-ceph-mon0: -184> 2018-04-17 04:35:25.539623 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391521000 :6790 s=STATE_OPEN pgs=83 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.532473 I | rook-ceph-mon0: -183> 2018-04-17 04:35:25.539631 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391521000 :6790 s=STATE_OPEN pgs=83 cs=1 l=1)._stop
- 2018-04-17 04:35:27.532491 I | rook-ceph-mon0: -182> 2018-04-17 04:35:25.539930 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d391550800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=40 -
- 2018-04-17 04:35:27.532509 I | rook-ceph-mon0: -181> 2018-04-17 04:35:25.540294 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391550800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=85 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.532526 I | rook-ceph-mon0: -180> 2018-04-17 04:35:25.540381 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391550800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=85 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.532551 I | rook-ceph-mon0: -179> 2018-04-17 04:35:25.540579 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391550800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=85 cs=1 l=1). rx client.? seq 1 0x55d3914b6a00 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.532597 I | rook-ceph-mon0: -178> 2018-04-17 04:35:25.540664 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.33.0:0/2502043250 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b6a00 con 0x55d391550800
- 2018-04-17 04:35:27.532623 I | rook-ceph-mon0: -177> 2018-04-17 04:35:25.773750 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d391522800 :6790 s=STATE_OPEN pgs=83 cs=1 l=1).read_bulk peer close file descriptor 41
- 2018-04-17 04:35:27.532647 I | rook-ceph-mon0: -176> 2018-04-17 04:35:25.773791 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d391522800 :6790 s=STATE_OPEN pgs=83 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.532697 I | rook-ceph-mon0: -175> 2018-04-17 04:35:25.773804 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d391522800 :6790 s=STATE_OPEN pgs=83 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.532736 I | rook-ceph-mon0: -174> 2018-04-17 04:35:25.773816 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d391522800 :6790 s=STATE_OPEN pgs=83 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.532756 I | rook-ceph-mon0: -173> 2018-04-17 04:35:25.773835 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d391522800 :6790 s=STATE_OPEN pgs=83 cs=1 l=1)._stop
- 2018-04-17 04:35:27.532779 I | rook-ceph-mon0: -172> 2018-04-17 04:35:25.774651 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d39156a000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=41 -
- 2018-04-17 04:35:27.532804 I | rook-ceph-mon0: -171> 2018-04-17 04:35:25.775370 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d39156a000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=85 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.532834 I | rook-ceph-mon0: -170> 2018-04-17 04:35:25.775918 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d39156a000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=85 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.532856 I | rook-ceph-mon0: -169> 2018-04-17 04:35:25.776070 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d39156a000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=85 cs=1 l=1). rx client.? seq 1 0x55d39155e280 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.532886 I | rook-ceph-mon0: -168> 2018-04-17 04:35:25.776140 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.249.1:0/2144414442 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d39155e280 con 0x55d39156a000
- 2018-04-17 04:35:27.532905 I | rook-ceph-mon0: -167> 2018-04-17 04:35:25.840460 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914a4800 :6790 s=STATE_OPEN pgs=138 cs=1 l=1).read_bulk peer close file descriptor 42
- 2018-04-17 04:35:27.532930 I | rook-ceph-mon0: -166> 2018-04-17 04:35:25.840498 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914a4800 :6790 s=STATE_OPEN pgs=138 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.532958 I | rook-ceph-mon0: -165> 2018-04-17 04:35:25.840510 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914a4800 :6790 s=STATE_OPEN pgs=138 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.532978 I | rook-ceph-mon0: -164> 2018-04-17 04:35:25.840517 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914a4800 :6790 s=STATE_OPEN pgs=138 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.533019 I | rook-ceph-mon0: -163> 2018-04-17 04:35:25.840524 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/3332407889 conn(0x55d3914a4800 :6790 s=STATE_OPEN pgs=138 cs=1 l=1)._stop
- 2018-04-17 04:35:27.533039 I | rook-ceph-mon0: -162> 2018-04-17 04:35:25.854395 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/1687677576 conn(0x55d3914a1800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).read_bulk peer close file descriptor 43
- 2018-04-17 04:35:27.533063 I | rook-ceph-mon0: -161> 2018-04-17 04:35:25.854424 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/1687677576 conn(0x55d3914a1800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.533097 I | rook-ceph-mon0: -160> 2018-04-17 04:35:25.854438 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/1687677576 conn(0x55d3914a1800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.533127 I | rook-ceph-mon0: -159> 2018-04-17 04:35:25.854450 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/1687677576 conn(0x55d3914a1800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.533158 I | rook-ceph-mon0: -158> 2018-04-17 04:35:25.854469 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/1687677576 conn(0x55d3914a1800 :6790 s=STATE_OPEN pgs=4 cs=1 l=1)._stop
- 2018-04-17 04:35:27.533177 I | rook-ceph-mon0: -157> 2018-04-17 04:35:26.131912 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a3000 :6790 s=STATE_OPEN pgs=5 cs=1 l=1).read_bulk peer close file descriptor 44
- 2018-04-17 04:35:27.533195 I | rook-ceph-mon0: -156> 2018-04-17 04:35:26.131965 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a3000 :6790 s=STATE_OPEN pgs=5 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.533213 I | rook-ceph-mon0: -155> 2018-04-17 04:35:26.131981 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a3000 :6790 s=STATE_OPEN pgs=5 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.533231 I | rook-ceph-mon0: -154> 2018-04-17 04:35:26.132038 7f382c568700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a3000 :6790 s=STATE_OPEN pgs=5 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.533249 I | rook-ceph-mon0: -153> 2018-04-17 04:35:26.132057 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/1017577090 conn(0x55d3914a3000 :6790 s=STATE_OPEN pgs=5 cs=1 l=1)._stop
- 2018-04-17 04:35:27.533266 I | rook-ceph-mon0: -152> 2018-04-17 04:35:26.132174 7f382bd67700 1 -- 10.107.181.203:6790/0 reap_dead start
- 2018-04-17 04:35:27.533286 I | rook-ceph-mon0: -151> 2018-04-17 04:35:26.132218 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d3914a1800
- 2018-04-17 04:35:27.533303 I | rook-ceph-mon0: -150> 2018-04-17 04:35:26.132231 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d3914a3000
- 2018-04-17 04:35:27.533335 I | rook-ceph-mon0: -149> 2018-04-17 04:35:26.132241 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d3914a4800
- 2018-04-17 04:35:27.533355 I | rook-ceph-mon0: -148> 2018-04-17 04:35:26.132259 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d3914ef800
- 2018-04-17 04:35:27.533380 I | rook-ceph-mon0: -147> 2018-04-17 04:35:26.132266 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d3914f2800
- 2018-04-17 04:35:27.533404 I | rook-ceph-mon0: -146> 2018-04-17 04:35:26.132263 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d39156b800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=42 -
- 2018-04-17 04:35:27.533433 I | rook-ceph-mon0: -145> 2018-04-17 04:35:26.132601 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d39156b800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=6 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.533454 I | rook-ceph-mon0: -144> 2018-04-17 04:35:26.132812 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d39156b800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=6 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.533484 I | rook-ceph-mon0: -143> 2018-04-17 04:35:26.132923 7f382c568700 5 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d39156b800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=6 cs=1 l=1). rx unknown.0 seq 1 0x55d39155ef00 auth(proto 0 34 bytes epoch 0)
- 2018-04-17 04:35:27.533504 I | rook-ceph-mon0: -142> 2018-04-17 04:35:26.133037 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== unknown.0 192.168.33.0:0/4209033655 1 ==== auth(proto 0 34 bytes epoch 0) ==== 60+0+0 (3679117932 0 0) 0x55d39155ef00 con 0x55d39156b800
- 2018-04-17 04:35:27.533529 I | rook-ceph-mon0: -141> 2018-04-17 04:35:27.164901 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914d4000 :6790 s=STATE_OPEN pgs=553 cs=1 l=1).read_bulk peer close file descriptor 45
- 2018-04-17 04:35:27.533558 I | rook-ceph-mon0: -140> 2018-04-17 04:35:27.164957 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914d4000 :6790 s=STATE_OPEN pgs=553 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.533578 I | rook-ceph-mon0: -139> 2018-04-17 04:35:27.164973 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914d4000 :6790 s=STATE_OPEN pgs=553 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.533596 I | rook-ceph-mon0: -138> 2018-04-17 04:35:27.164985 7f382cd69700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914d4000 :6790 s=STATE_OPEN pgs=553 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.533614 I | rook-ceph-mon0: -137> 2018-04-17 04:35:27.164994 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d3914d4000 :6790 s=STATE_OPEN pgs=553 cs=1 l=1)._stop
- 2018-04-17 04:35:27.533640 I | rook-ceph-mon0: -136> 2018-04-17 04:35:27.165599 7f382cd69700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d39156d000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=43 -
- 2018-04-17 04:35:27.533669 I | rook-ceph-mon0: -135> 2018-04-17 04:35:27.166268 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d39156d000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=555 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.533726 I | rook-ceph-mon0: -134> 2018-04-17 04:35:27.166736 7f382cd69700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d39156d000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=555 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.533747 I | rook-ceph-mon0: -133> 2018-04-17 04:35:27.166877 7f382cd69700 5 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d39156d000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=555 cs=1 l=1). rx client.? seq 1 0x55d39155e500 auth(proto 0 39 bytes epoch 0) v1
- 2018-04-17 04:35:27.533775 I | rook-ceph-mon0: -132> 2018-04-17 04:35:27.166973 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.249.1:0/2171750696 1 ==== auth(proto 0 39 bytes epoch 0) v1 ==== 69+0+0 (914456824 0 0) 0x55d39155e500 con 0x55d39156d000
- 2018-04-17 04:35:27.533796 I | rook-ceph-mon0: -131> 2018-04-17 04:35:27.214188 7f382c568700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d39156e800 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=44 -
- 2018-04-17 04:35:27.533827 I | rook-ceph-mon0: -130> 2018-04-17 04:35:27.215021 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.59.35:6800/28 conn(0x55d39156e800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=411 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.533847 I | rook-ceph-mon0: -129> 2018-04-17 04:35:27.215457 7f382c568700 2 -- 10.107.181.203:6790/0 >> 192.168.59.35:6800/28 conn(0x55d39156e800 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=411 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.533874 I | rook-ceph-mon0: -128> 2018-04-17 04:35:27.215637 7f382c568700 5 -- 10.107.181.203:6790/0 >> 192.168.59.35:6800/28 conn(0x55d39156e800 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=411 cs=1 l=1). rx osd.1 seq 1 0x55d39155f180 auth(proto 0 26 bytes epoch 0) v1
- 2018-04-17 04:35:27.533908 I | rook-ceph-mon0: -127> 2018-04-17 04:35:27.215705 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== osd.1 192.168.59.35:6800/28 1 ==== auth(proto 0 26 bytes epoch 0) v1 ==== 56+0+0 (3660054698 0 0) 0x55d39155f180 con 0x55d39156e800
- 2018-04-17 04:35:27.533932 I | rook-ceph-mon0: -126> 2018-04-17 04:35:27.273365 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914d5800 :6790 s=STATE_OPEN pgs=128 cs=1 l=1).read_bulk peer close file descriptor 34
- 2018-04-17 04:35:27.533960 I | rook-ceph-mon0: -125> 2018-04-17 04:35:27.273402 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914d5800 :6790 s=STATE_OPEN pgs=128 cs=1 l=1).read_until read failed
- 2018-04-17 04:35:27.533980 I | rook-ceph-mon0: -124> 2018-04-17 04:35:27.273416 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914d5800 :6790 s=STATE_OPEN pgs=128 cs=1 l=1).process read tag failed
- 2018-04-17 04:35:27.534003 I | rook-ceph-mon0: -123> 2018-04-17 04:35:27.273428 7f382bd67700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914d5800 :6790 s=STATE_OPEN pgs=128 cs=1 l=1).fault on lossy channel, failing
- 2018-04-17 04:35:27.534037 I | rook-ceph-mon0: -122> 2018-04-17 04:35:27.273439 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d3914d5800 :6790 s=STATE_OPEN pgs=128 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534059 I | rook-ceph-mon0: -121> 2018-04-17 04:35:27.274378 7f382bd67700 1 -- 10.107.181.203:6790/0 >> - conn(0x55d391580000 :6790 s=STATE_ACCEPTING pgs=0 cs=0 l=0)._process_connection sd=34 -
- 2018-04-17 04:35:27.534089 I | rook-ceph-mon0: -120> 2018-04-17 04:35:27.275469 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391580000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=130 cs=1 l=1).handle_connect_msg accept write reply msg done
- 2018-04-17 04:35:27.534108 I | rook-ceph-mon0: -119> 2018-04-17 04:35:27.276039 7f382bd67700 2 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391580000 :6790 s=STATE_ACCEPTING_WAIT_SEQ pgs=130 cs=1 l=1)._process_connection accept get newly_acked_seq 0
- 2018-04-17 04:35:27.534127 I | rook-ceph-mon0: -118> 2018-04-17 04:35:27.276216 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391580000 :6790 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=130 cs=1 l=1). rx client.? seq 1 0x55d3914b6000 auth(proto 0 34 bytes epoch 0) v1
- 2018-04-17 04:35:27.534147 I | rook-ceph-mon0: -117> 2018-04-17 04:35:27.276295 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== client.? 192.168.59.0:0/1209919990 1 ==== auth(proto 0 34 bytes epoch 0) v1 ==== 64+0+0 (4015746775 0 0) 0x55d3914b6000 con 0x55d391580000
- 2018-04-17 04:35:27.534175 I | rook-ceph-mon0: -116> 2018-04-17 04:35:27.489257 7f3832574700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d391536000 :6790 s=STATE_OPEN pgs=140 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534195 I | rook-ceph-mon0: -115> 2018-04-17 04:35:27.489301 7f3832574700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3926288723 conn(0x55d391536000 :6790 s=STATE_OPEN pgs=140 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534213 I | rook-ceph-mon0: -114> 2018-04-17 04:35:27.489367 7f3832574700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391537800 :6790 s=STATE_OPEN pgs=183 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534232 I | rook-ceph-mon0: -113> 2018-04-17 04:35:27.489388 7f3832574700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2662115732 conn(0x55d391537800 :6790 s=STATE_OPEN pgs=183 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534251 I | rook-ceph-mon0: -112> 2018-04-17 04:35:27.489422 7f3832574700 1 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391539000 :6790 s=STATE_OPEN pgs=355 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534283 I | rook-ceph-mon0: -111> 2018-04-17 04:35:27.489448 7f3832574700 2 -- 10.107.181.203:6790/0 >> 192.168.108.184:6800/29 conn(0x55d391539000 :6790 s=STATE_OPEN pgs=355 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534302 I | rook-ceph-mon0: -110> 2018-04-17 04:35:27.489475 7f3832574700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d39153a800 :6790 s=STATE_OPEN pgs=182 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534327 I | rook-ceph-mon0: -109> 2018-04-17 04:35:27.489489 7f3832574700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/823466689 conn(0x55d39153a800 :6790 s=STATE_OPEN pgs=182 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534357 I | rook-ceph-mon0: -108> 2018-04-17 04:35:27.489519 7f3832574700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d39154c000 :6790 s=STATE_OPEN pgs=5 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534376 I | rook-ceph-mon0: -107> 2018-04-17 04:35:27.489532 7f3832574700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/3111804194 conn(0x55d39154c000 :6790 s=STATE_OPEN pgs=5 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534400 I | rook-ceph-mon0: -106> 2018-04-17 04:35:27.489552 7f3832574700 1 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39154d800 :6790 s=STATE_OPEN pgs=701 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534424 I | rook-ceph-mon0: -105> 2018-04-17 04:35:27.489560 7f382bd67700 1 -- 10.107.181.203:6790/0 reap_dead start
- 2018-04-17 04:35:27.534452 I | rook-ceph-mon0: -104> 2018-04-17 04:35:27.489575 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d391536000
- 2018-04-17 04:35:27.534471 I | rook-ceph-mon0: -103> 2018-04-17 04:35:27.489584 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d391537800
- 2018-04-17 04:35:27.534497 I | rook-ceph-mon0: -102> 2018-04-17 04:35:27.489589 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d391539000
- 2018-04-17 04:35:27.534517 I | rook-ceph-mon0: -101> 2018-04-17 04:35:27.489594 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d39153a800
- 2018-04-17 04:35:27.534542 I | rook-ceph-mon0: -100> 2018-04-17 04:35:27.489599 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d39154c000
- 2018-04-17 04:35:27.534562 I | rook-ceph-mon0: -99> 2018-04-17 04:35:27.489607 7f3832574700 2 -- 10.107.181.203:6790/0 >> 192.168.33.56:6800/4939 conn(0x55d39154d800 :6790 s=STATE_OPEN pgs=701 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534589 I | rook-ceph-mon0: -98> 2018-04-17 04:35:27.489650 7f3832574700 1 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39154f000 :6790 s=STATE_OPEN pgs=78 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534612 I | rook-ceph-mon0: -97> 2018-04-17 04:35:27.489666 7f3832574700 2 -- 10.107.181.203:6790/0 >> 199.96.132.12:0/2329353454 conn(0x55d39154f000 :6790 s=STATE_OPEN pgs=78 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534640 I | rook-ceph-mon0: -96> 2018-04-17 04:35:27.489717 7f3832574700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391550800 :6790 s=STATE_OPEN pgs=85 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534661 I | rook-ceph-mon0: -95> 2018-04-17 04:35:27.489735 7f3832574700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/2502043250 conn(0x55d391550800 :6790 s=STATE_OPEN pgs=85 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534703 I | rook-ceph-mon0: -94> 2018-04-17 04:35:27.489768 7f3832574700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d39156a000 :6790 s=STATE_OPEN pgs=85 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534735 I | rook-ceph-mon0: -93> 2018-04-17 04:35:27.489782 7f3832574700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2144414442 conn(0x55d39156a000 :6790 s=STATE_OPEN pgs=85 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534755 I | rook-ceph-mon0: -92> 2018-04-17 04:35:27.489813 7f3832574700 1 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d39156b800 :6790 s=STATE_OPEN pgs=6 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534773 I | rook-ceph-mon0: -91> 2018-04-17 04:35:27.489827 7f3832574700 2 -- 10.107.181.203:6790/0 >> 192.168.33.0:0/4209033655 conn(0x55d39156b800 :6790 s=STATE_OPEN pgs=6 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534812 I | rook-ceph-mon0: -90> 2018-04-17 04:35:27.489850 7f3832574700 1 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d39156d000 :6790 s=STATE_OPEN pgs=555 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534841 I | rook-ceph-mon0: -89> 2018-04-17 04:35:27.489862 7f3832574700 2 -- 10.107.181.203:6790/0 >> 192.168.249.1:0/2171750696 conn(0x55d39156d000 :6790 s=STATE_OPEN pgs=555 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534860 I | rook-ceph-mon0: -88> 2018-04-17 04:35:27.489876 7f3832574700 1 -- 10.107.181.203:6790/0 >> 192.168.59.35:6800/28 conn(0x55d39156e800 :6790 s=STATE_OPEN pgs=411 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534887 I | rook-ceph-mon0: -87> 2018-04-17 04:35:27.489888 7f3832574700 2 -- 10.107.181.203:6790/0 >> 192.168.59.35:6800/28 conn(0x55d39156e800 :6790 s=STATE_OPEN pgs=411 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534906 I | rook-ceph-mon0: -86> 2018-04-17 04:35:27.489903 7f3832574700 1 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391580000 :6790 s=STATE_OPEN pgs=130 cs=1 l=1).mark_down
- 2018-04-17 04:35:27.534935 I | rook-ceph-mon0: -85> 2018-04-17 04:35:27.489915 7f3832574700 2 -- 10.107.181.203:6790/0 >> 192.168.59.0:0/1209919990 conn(0x55d391580000 :6790 s=STATE_OPEN pgs=130 cs=1 l=1)._stop
- 2018-04-17 04:35:27.534959 I | rook-ceph-mon0: -84> 2018-04-17 04:35:27.490597 7f382bd67700 1 -- 10.107.181.203:6790/0 reap_dead start
- 2018-04-17 04:35:27.534987 I | rook-ceph-mon0: -83> 2018-04-17 04:35:27.490618 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d39154d800
- 2018-04-17 04:35:27.535006 I | rook-ceph-mon0: -82> 2018-04-17 04:35:27.490630 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d39154f000
- 2018-04-17 04:35:27.535033 I | rook-ceph-mon0: -81> 2018-04-17 04:35:27.490637 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d391550800
- 2018-04-17 04:35:27.535052 I | rook-ceph-mon0: -80> 2018-04-17 04:35:27.490646 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d39156a000
- 2018-04-17 04:35:27.535078 I | rook-ceph-mon0: -79> 2018-04-17 04:35:27.490660 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d39156b800
- 2018-04-17 04:35:27.535096 I | rook-ceph-mon0: -78> 2018-04-17 04:35:27.490675 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d39156d000
- 2018-04-17 04:35:27.535123 I | rook-ceph-mon0: -77> 2018-04-17 04:35:27.490735 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d39156e800
- 2018-04-17 04:35:27.535143 I | rook-ceph-mon0: -76> 2018-04-17 04:35:27.490742 7f382bd67700 5 -- 10.107.181.203:6790/0 reap_dead delete 0x55d391580000
- 2018-04-17 04:35:27.535169 I | rook-ceph-mon0: -75> 2018-04-17 04:35:27.490747 7f382bd67700 1 -- 10.107.181.203:6790/0 reap_dead start
- 2018-04-17 04:35:27.535186 I | rook-ceph-mon0: -74> 2018-04-17 04:35:27.490752 7f382bd67700 1 -- 10.107.181.203:6790/0 reap_dead start
- 2018-04-17 04:35:27.535203 I | rook-ceph-mon0: -73> 2018-04-17 04:35:27.490756 7f382bd67700 1 -- 10.107.181.203:6790/0 reap_dead start
- 2018-04-17 04:35:27.535221 I | rook-ceph-mon0: -72> 2018-04-17 04:35:27.502585 7f3832574700 1 -- 10.107.181.203:6790/0 _send_message--> mon.2 10.111.191.96:6790/0 -- election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 victory 960) v7 -- ?+0 0x55d3912f1a00
- 2018-04-17 04:35:27.535238 I | rook-ceph-mon0: -71> 2018-04-17 04:35:27.502617 7f3832574700 1 -- 10.107.181.203:6790/0 --> 10.111.191.96:6790/0 -- election(d4f1a1ca-b919-4c5b-89f2-1aed3d913a97 victory 960) v7 -- 0x55d3912f1a00 con 0
- 2018-04-17 04:35:27.535256 I | rook-ceph-mon0: -70> 2018-04-17 04:35:27.502668 7f3832574700 0 log_channel(cluster) log [INF] : mon.rook-ceph-mon0 is new leader, mons rook-ceph-mon0,rook-ceph-mon2 in quorum (ranks 1,2)
- 2018-04-17 04:35:27.535274 I | rook-ceph-mon0: -69> 2018-04-17 04:35:27.502737 7f3832574700 10 log_client _send_to_monlog to self
- 2018-04-17 04:35:27.535291 I | rook-ceph-mon0: -68> 2018-04-17 04:35:27.502744 7f3832574700 10 log_client log_queue is 2 last_log 2 sent 1 num 2 unsent 1 sending 1
- 2018-04-17 04:35:27.535311 I | rook-ceph-mon0: -67> 2018-04-17 04:35:27.502750 7f3832574700 10 log_client will send 2018-04-17 04:35:27.502728 mon.rook-ceph-mon0 mon.1 10.107.181.203:6790/0 2 : cluster [INF] mon.rook-ceph-mon0 is new leader, mons rook-ceph-mon0,rook-ceph-mon2 in quorum (ranks 1,2)
- 2018-04-17 04:35:27.535328 I | rook-ceph-mon0: -66> 2018-04-17 04:35:27.502781 7f3832574700 1 -- 10.107.181.203:6790/0 --> 10.107.181.203:6790/0 -- log(1 entries from seq 2 at 2018-04-17 04:35:27.502728) v1 -- 0x55d3914b6000 con 0
- 2018-04-17 04:35:27.535357 I | rook-ceph-mon0: -65> 2018-04-17 04:35:27.503290 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.1 10.107.181.203:6790/0 0 ==== log(1 entries from seq 2 at 2018-04-17 04:35:27.502728) v1 ==== 0+0+0 (0 0 0) 0x55d3914b6000 con 0x55d390f0f800
- 2018-04-17 04:35:27.535377 I | rook-ceph-mon0: -64> 2018-04-17 04:35:27.505412 7f3832574700 1 -- 10.107.181.203:6790/0 _send_message--> mon.2 10.111.191.96:6790/0 -- paxos(collect lc 48881 fc 48193 pn 13301 opn 0) v4 -- ?+0 0x55d390f31800
- 2018-04-17 04:35:27.535401 I | rook-ceph-mon0: -63> 2018-04-17 04:35:27.505450 7f3832574700 1 -- 10.107.181.203:6790/0 --> 10.111.191.96:6790/0 -- paxos(collect lc 48881 fc 48193 pn 13301 opn 0) v4 -- 0x55d390f31800 con 0
- 2018-04-17 04:35:27.535431 I | rook-ceph-mon0: -62> 2018-04-17 04:35:27.505616 7f3832574700 1 -- 10.107.181.203:6790/0 _send_message--> mon.2 10.111.191.96:6790/0 -- time_check( ping e 960 r 1 ) v1 -- ?+0 0x55d39155f180
- 2018-04-17 04:35:27.535461 I | rook-ceph-mon0: -61> 2018-04-17 04:35:27.505652 7f3832574700 1 -- 10.107.181.203:6790/0 --> 10.111.191.96:6790/0 -- time_check( ping e 960 r 1 ) v1 -- 0x55d39155f180 con 0
- 2018-04-17 04:35:27.535485 I | rook-ceph-mon0: -60> 2018-04-17 04:35:27.505821 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.505826 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.535513 I | rook-ceph-mon0: -59> 2018-04-17 04:35:27.505855 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.505859 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.535548 I | rook-ceph-mon0: -58> 2018-04-17 04:35:27.506503 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240645 0x55d390f31800 forward(log(1 entries from seq 1 at 2018-04-17 04:28:54.000928) v1 caps allow * tid 1 con_features 2305244844532236283) v3
- 2018-04-17 04:35:27.535578 I | rook-ceph-mon0: -57> 2018-04-17 04:35:27.506598 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240645 ==== forward(log(1 entries from seq 1 at 2018-04-17 04:28:54.000928) v1 caps allow * tid 1 con_features 2305244844532236283) v3 ==== 349+0+0 (3638531231 0 0) 0x55d390f31800 con 0x55d39147a800
- 2018-04-17 04:35:27.535597 I | rook-ceph-mon0: -56> 2018-04-17 04:35:27.506730 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.506734 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.535621 I | rook-ceph-mon0: -55> 2018-04-17 04:35:27.506762 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.506766 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.535647 I | rook-ceph-mon0: -54> 2018-04-17 04:35:27.506765 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240646 0x55d390f31b00 forward(log(1 entries from seq 2 at 2018-04-17 04:29:37.204174) v1 caps allow * tid 2 con_features 2305244844532236283) v3
- 2018-04-17 04:35:27.535673 I | rook-ceph-mon0: -53> 2018-04-17 04:35:27.506807 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240646 ==== forward(log(1 entries from seq 2 at 2018-04-17 04:29:37.204174) v1 caps allow * tid 2 con_features 2305244844532236283) v3 ==== 349+0+0 (827325185 0 0) 0x55d390f31b00 con 0x55d39147a800
- 2018-04-17 04:35:27.535727 I | rook-ceph-mon0: -52> 2018-04-17 04:35:27.506855 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240647 0x55d390f31e00 forward(log(1 entries from seq 3 at 2018-04-17 04:29:54.016053) v1 caps allow * tid 3 con_features 2305244844532236283) v3
- 2018-04-17 04:35:27.535748 I | rook-ceph-mon0: -51> 2018-04-17 04:35:27.506869 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.506873 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.535766 I | rook-ceph-mon0: -50> 2018-04-17 04:35:27.506930 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.506934 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.535786 I | rook-ceph-mon0: -49> 2018-04-17 04:35:27.506967 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240647 ==== forward(log(1 entries from seq 3 at 2018-04-17 04:29:54.016053) v1 caps allow * tid 3 con_features 2305244844532236283) v3 ==== 349+0+0 (2431104830 0 0) 0x55d390f31e00 con 0x55d39147a800
- 2018-04-17 04:35:27.535806 I | rook-ceph-mon0: -48> 2018-04-17 04:35:27.507026 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.507031 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.535838 I | rook-ceph-mon0: -47> 2018-04-17 04:35:27.507043 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240648 0x55d390f32100 forward(log(1 entries from seq 4 at 2018-04-17 04:31:23.040613) v1 caps allow * tid 4 con_features 2305244844532236283) v3
- 2018-04-17 04:35:27.535858 I | rook-ceph-mon0: -46> 2018-04-17 04:35:27.507059 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.507061 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.535883 I | rook-ceph-mon0: -45> 2018-04-17 04:35:27.507084 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240648 ==== forward(log(1 entries from seq 4 at 2018-04-17 04:31:23.040613) v1 caps allow * tid 4 con_features 2305244844532236283) v3 ==== 349+0+0 (556152411 0 0) 0x55d390f32100 con 0x55d39147a800
- 2018-04-17 04:35:27.535917 I | rook-ceph-mon0: -44> 2018-04-17 04:35:27.507111 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240649 0x55d390f31800 forward(log(1 entries from seq 5 at 2018-04-17 04:33:16.037885) v1 caps allow * tid 5 con_features 2305244844532236283) v3
- 2018-04-17 04:35:27.535947 I | rook-ceph-mon0: -43> 2018-04-17 04:35:27.507135 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.507138 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.535967 I | rook-ceph-mon0: -42> 2018-04-17 04:35:27.507148 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.507150 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.535993 I | rook-ceph-mon0: -41> 2018-04-17 04:35:27.507166 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240649 ==== forward(log(1 entries from seq 5 at 2018-04-17 04:33:16.037885) v1 caps allow * tid 5 con_features 2305244844532236283) v3 ==== 349+0+0 (2606756714 0 0) 0x55d390f31800 con 0x55d39147a800
- 2018-04-17 04:35:27.536018 I | rook-ceph-mon0: -40> 2018-04-17 04:35:27.507176 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240650 0x55d390f31b00 forward(log(1 entries from seq 6 at 2018-04-17 04:33:37.058179) v1 caps allow * tid 6 con_features 2305244844532236283) v3
- 2018-04-17 04:35:27.536038 I | rook-ceph-mon0: -39> 2018-04-17 04:35:27.507211 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.507214 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.536062 I | rook-ceph-mon0: -38> 2018-04-17 04:35:27.507245 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.507247 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.536086 I | rook-ceph-mon0: -37> 2018-04-17 04:35:27.507264 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240650 ==== forward(log(1 entries from seq 6 at 2018-04-17 04:33:37.058179) v1 caps allow * tid 6 con_features 2305244844532236283) v3 ==== 349+0+0 (4041820753 0 0) 0x55d390f31b00 con 0x55d39147a800
- 2018-04-17 04:35:27.536121 I | rook-ceph-mon0: -36> 2018-04-17 04:35:27.507271 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240651 0x55d390f32400 forward(log(1 entries from seq 7 at 2018-04-17 04:34:12.505226) v1 caps allow * tid 7 con_features 2305244844532236283) v3
- 2018-04-17 04:35:27.536142 I | rook-ceph-mon0: -35> 2018-04-17 04:35:27.507306 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.507309 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.536175 I | rook-ceph-mon0: -34> 2018-04-17 04:35:27.507326 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.507328 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.536195 I | rook-ceph-mon0: -33> 2018-04-17 04:35:27.507356 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240651 ==== forward(log(1 entries from seq 7 at 2018-04-17 04:34:12.505226) v1 caps allow * tid 7 con_features 2305244844532236283) v3 ==== 349+0+0 (3391053603 0 0) 0x55d390f32400 con 0x55d39147a800
- 2018-04-17 04:35:27.536226 I | rook-ceph-mon0: -32> 2018-04-17 04:35:27.507366 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240652 0x55d390f31e00 forward(log(1 entries from seq 8 at 2018-04-17 04:34:29.030878) v1 caps allow * tid 8 con_features 2305244844532236283) v3
- 2018-04-17 04:35:27.536244 I | rook-ceph-mon0: -31> 2018-04-17 04:35:27.507392 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.507394 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.536263 I | rook-ceph-mon0: -30> 2018-04-17 04:35:27.507404 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.507407 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.536281 I | rook-ceph-mon0: -29> 2018-04-17 04:35:27.507423 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240652 ==== forward(log(1 entries from seq 8 at 2018-04-17 04:34:29.030878) v1 caps allow * tid 8 con_features 2305244844532236283) v3 ==== 349+0+0 (1077725937 0 0) 0x55d390f31e00 con 0x55d39147a800
- 2018-04-17 04:35:27.536300 I | rook-ceph-mon0: -28> 2018-04-17 04:35:27.507466 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.507468 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.536319 I | rook-ceph-mon0: -27> 2018-04-17 04:35:27.507494 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos recovering c 48193..48881) is_readable = 0 - now=2018-04-17 04:35:27.507498 lease_expire=0.000000 has v0 lc 48881
- 2018-04-17 04:35:27.536340 I | rook-ceph-mon0: -26> 2018-04-17 04:35:27.508248 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240653 0x55d390f32100 paxos(last lc 48881 fc 48193 pn 13301 opn 0) v4
- 2018-04-17 04:35:27.536359 I | rook-ceph-mon0: -25> 2018-04-17 04:35:27.508344 7f382fd6f700 1 -- 10.107.181.203:6790/0 <== mon.2 10.111.191.96:6790/0 776240653 ==== paxos(last lc 48881 fc 48193 pn 13301 opn 0) v4 ==== 84+0+0 (2544013773 0 0) 0x55d390f32100 con 0x55d39147a800
- 2018-04-17 04:35:27.536378 I | rook-ceph-mon0: -24> 2018-04-17 04:35:27.508424 7f382fd6f700 1 -- 10.107.181.203:6790/0 _send_message--> mon.2 10.111.191.96:6790/0 -- paxos(lease lc 48881 fc 48193 pn 0 opn 0) v4 -- ?+0 0x55d390f31e00
- 2018-04-17 04:35:27.536403 I | rook-ceph-mon0: -23> 2018-04-17 04:35:27.508424 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240654 0x55d39155f180 time_check( pong e 960 r 1 ts 2018-04-17 04:35:27.513188 ) v1
- 2018-04-17 04:35:27.536431 I | rook-ceph-mon0: -22> 2018-04-17 04:35:27.508469 7f382fd6f700 1 -- 10.107.181.203:6790/0 --> 10.111.191.96:6790/0 -- paxos(lease lc 48881 fc 48193 pn 0 opn 0) v4 -- 0x55d390f31e00 con 0
- 2018-04-17 04:35:27.536460 I | rook-ceph-mon0: -21> 2018-04-17 04:35:27.509103 7f382fd6f700 4 mgrc handle_mgr_map Got map version 5
- 2018-04-17 04:35:27.536484 I | rook-ceph-mon0: -20> 2018-04-17 04:35:27.509205 7f382fd6f700 4 mgrc handle_mgr_map Active mgr is now -
- 2018-04-17 04:35:27.536510 I | rook-ceph-mon0: -19> 2018-04-17 04:35:27.509213 7f382fd6f700 4 mgrc reconnect No active mgr available yet
- 2018-04-17 04:35:27.536530 I | rook-ceph-mon0: -18> 2018-04-17 04:35:27.509583 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240655 0x55d390f31e00 paxos(lease_ack lc 48881 fc 48193 pn 0 opn 0) v4
- 2018-04-17 04:35:27.536559 I | rook-ceph-mon0: -17> 2018-04-17 04:35:27.509761 7f382fd6f700 0 log_channel(cluster) log [DBG] : monmap e3: 3 mons at {rook-ceph-mon0=10.107.181.203:6790/0,rook-ceph-mon1=10.97.51.86:6790/0,rook-ceph-mon2=10.111.191.96:6790/0}
- 2018-04-17 04:35:27.536578 I | rook-ceph-mon0: -16> 2018-04-17 04:35:27.509788 7f382fd6f700 10 log_client _send_to_monlog to self
- 2018-04-17 04:35:27.536601 I | rook-ceph-mon0: -15> 2018-04-17 04:35:27.509794 7f382fd6f700 10 log_client log_queue is 3 last_log 3 sent 2 num 3 unsent 1 sending 1
- 2018-04-17 04:35:27.536626 I | rook-ceph-mon0: -14> 2018-04-17 04:35:27.509834 7f382fd6f700 10 log_client will send 2018-04-17 04:35:27.509783 mon.rook-ceph-mon0 mon.1 10.107.181.203:6790/0 3 : cluster [DBG] monmap e3: 3 mons at {rook-ceph-mon0=10.107.181.203:6790/0,rook-ceph-mon1=10.97.51.86:6790/0,rook-ceph-mon2=10.111.191.96:6790/0}
- 2018-04-17 04:35:27.536661 I | rook-ceph-mon0: -13> 2018-04-17 04:35:27.509869 7f382fd6f700 1 -- 10.107.181.203:6790/0 --> 10.107.181.203:6790/0 -- log(1 entries from seq 3 at 2018-04-17 04:35:27.509783) v1 -- 0x55d390eb9980 con 0
- 2018-04-17 04:35:27.536713 I | rook-ceph-mon0: -12> 2018-04-17 04:35:27.509927 7f382fd6f700 5 mon.rook-ceph-mon0@1(leader).paxos(paxos active c 48193..48881) is_readable = 1 - now=2018-04-17 04:35:27.509932 lease_expire=2018-04-17 04:35:32.508393 has v0 lc 48881
- 2018-04-17 04:35:27.536745 I | rook-ceph-mon0: -11> 2018-04-17 04:35:27.510409 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240656 0x55d390f31800 forward(log(1 entries from seq 9 at 2018-04-17 04:35:18.045995) v1 caps allow * tid 9 con_features 2305244844532236283) v3
- 2018-04-17 04:35:27.536764 I | rook-ceph-mon0: -10> 2018-04-17 04:35:27.510485 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240657 0x55d3913c2000 global_id (34096) v1
- 2018-04-17 04:35:27.536788 I | rook-ceph-mon0: -9> 2018-04-17 04:35:27.510613 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240658 0x55d3913c3e00 global_id (34096) v1
- 2018-04-17 04:35:27.536807 I | rook-ceph-mon0: -8> 2018-04-17 04:35:27.510728 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240659 0x55d3913c4000 global_id (34096) v1
- 2018-04-17 04:35:27.536836 I | rook-ceph-mon0: -7> 2018-04-17 04:35:27.510857 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240660 0x55d3913c4200 global_id (34096) v1
- 2018-04-17 04:35:27.536855 I | rook-ceph-mon0: -6> 2018-04-17 04:35:27.510920 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240661 0x55d3913c4400 global_id (34096) v1
- 2018-04-17 04:35:27.536879 I | rook-ceph-mon0: -5> 2018-04-17 04:35:27.510987 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240662 0x55d3913c4600 global_id (34096) v1
- 2018-04-17 04:35:27.536905 I | rook-ceph-mon0: -4> 2018-04-17 04:35:27.511058 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240663 0x55d3913c4800 global_id (34096) v1
- 2018-04-17 04:35:27.536923 I | rook-ceph-mon0: -3> 2018-04-17 04:35:27.511108 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240664 0x55d3913c4a00 global_id (34096) v1
- 2018-04-17 04:35:27.536941 I | rook-ceph-mon0: -2> 2018-04-17 04:35:27.511235 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240665 0x55d3913c4c00 global_id (34096) v1
- 2018-04-17 04:35:27.536997 I | rook-ceph-mon0: -1> 2018-04-17 04:35:27.511298 7f382bd67700 5 -- 10.107.181.203:6790/0 >> 10.111.191.96:6790/0 conn(0x55d39147a800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=1518 cs=1 l=0). rx mon.2 seq 776240666 0x55d3913c4e00 global_id (34096) v1
- 2018-04-17 04:35:27.537028 I | rook-ceph-mon0: 0> 2018-04-17 04:35:27.518367 7f382fd6f700 -1 /build/ceph-12.2.4/src/mds/FSMap.cc: In function 'void FSMap::assign_standby_replay(mds_gid_t, fs_cluster_id_t, mds_rank_t)' thread 7f382fd6f700 time 2018-04-17 04:35:27.510001
- 2018-04-17 04:35:27.537047 I | rook-ceph-mon0: /build/ceph-12.2.4/src/mds/FSMap.cc: 876: FAILED assert(mds_roles.at(standby_gid) == FS_CLUSTER_ID_NONE)
- 2018-04-17 04:35:27.537070 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.537096 I | rook-ceph-mon0: ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)
- 2018-04-17 04:35:27.537122 I | rook-ceph-mon0: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x55d387221672]
- 2018-04-17 04:35:27.537146 I | rook-ceph-mon0: 2: (FSMap::assign_standby_replay(mds_gid_t, int, int)+0x457) [0x55d3874b9eb7]
- 2018-04-17 04:35:27.537180 I | rook-ceph-mon0: 3: (MDSMonitor::try_standby_replay(MDSMap::mds_info_t const&, Filesystem const&, MDSMap::mds_info_t const&)+0x222) [0x55d38719bfe2]
- 2018-04-17 04:35:27.537198 I | rook-ceph-mon0: 4: (MDSMonitor::maybe_promote_standby(std::shared_ptr<Filesystem>)+0xc7c) [0x55d3871a004c]
- 2018-04-17 04:35:27.537226 I | rook-ceph-mon0: 5: (MDSMonitor::tick()+0x8ea) [0x55d3871a6c8a]
- 2018-04-17 04:35:27.537244 I | rook-ceph-mon0: 6: (MDSMonitor::on_active()+0x28) [0x55d38719bc88]
- 2018-04-17 04:35:27.537287 I | rook-ceph-mon0: 7: (PaxosService::_active()+0x40a) [0x55d3870fb77a]
- 2018-04-17 04:35:27.537306 I | rook-ceph-mon0: 8: (Context::complete(int)+0x9) [0x55d386fd1629]
- 2018-04-17 04:35:27.537325 I | rook-ceph-mon0: 9: (void finish_contexts<Context>(CephContext*, std::__cxx11::list<Context*, std::allocator<Context*> >&, int)+0x20b) [0x55d386fdb01b]
- 2018-04-17 04:35:27.537345 I | rook-ceph-mon0: 10: (Paxos::finish_round()+0x188) [0x55d3870f3358]
- 2018-04-17 04:35:27.537364 I | rook-ceph-mon0: 11: (Paxos::handle_last(boost::intrusive_ptr<MonOpRequest>)+0xf9d) [0x55d3870f486d]
- 2018-04-17 04:35:27.537382 I | rook-ceph-mon0: 12: (Paxos::dispatch(boost::intrusive_ptr<MonOpRequest>)+0x263) [0x55d3870f51c3]
- 2018-04-17 04:35:27.537405 I | rook-ceph-mon0: 13: (Monitor::dispatch_op(boost::intrusive_ptr<MonOpRequest>)+0xefe) [0x55d386fc72ce]
- 2018-04-17 04:35:27.537430 I | rook-ceph-mon0: 14: (Monitor::_ms_dispatch(Message*)+0x6db) [0x55d386fc7e5b]
- 2018-04-17 04:35:27.537456 I | rook-ceph-mon0: 15: (Monitor::ms_dispatch(Message*)+0x23) [0x55d386ff7d93]
- 2018-04-17 04:35:27.537480 I | rook-ceph-mon0: 16: (DispatchQueue::entry()+0xf4a) [0x55d38752282a]
- 2018-04-17 04:35:27.537506 I | rook-ceph-mon0: 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x55d3872d1a8d]
- 2018-04-17 04:35:27.537530 I | rook-ceph-mon0: 18: (()+0x76ba) [0x7f3837abc6ba]
- 2018-04-17 04:35:27.537548 I | rook-ceph-mon0: 19: (clone()+0x6d) [0x7f38362e641d]
- 2018-04-17 04:35:27.537576 I | rook-ceph-mon0: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- 2018-04-17 04:35:27.537595 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.537619 I | rook-ceph-mon0: --- logging levels ---
- 2018-04-17 04:35:27.537644 I | rook-ceph-mon0: 0/ 5 none
- 2018-04-17 04:35:27.537669 I | rook-ceph-mon0: 0/ 1 lockdep
- 2018-04-17 04:35:27.537726 I | rook-ceph-mon0: 0/ 1 context
- 2018-04-17 04:35:27.537746 I | rook-ceph-mon0: 1/ 1 crush
- 2018-04-17 04:35:27.537769 I | rook-ceph-mon0: 1/ 5 mds
- 2018-04-17 04:35:27.537793 I | rook-ceph-mon0: 1/ 5 mds_balancer
- 2018-04-17 04:35:27.537820 I | rook-ceph-mon0: 1/ 5 mds_locker
- 2018-04-17 04:35:27.537844 I | rook-ceph-mon0: 1/ 5 mds_log
- 2018-04-17 04:35:27.537869 I | rook-ceph-mon0: 1/ 5 mds_log_expire
- 2018-04-17 04:35:27.537894 I | rook-ceph-mon0: 1/ 5 mds_migrator
- 2018-04-17 04:35:27.537919 I | rook-ceph-mon0: 0/ 1 buffer
- 2018-04-17 04:35:27.537945 I | rook-ceph-mon0: 0/ 1 timer
- 2018-04-17 04:35:27.537969 I | rook-ceph-mon0: 0/ 1 filer
- 2018-04-17 04:35:27.537993 I | rook-ceph-mon0: 0/ 1 striper
- 2018-04-17 04:35:27.538019 I | rook-ceph-mon0: 0/ 1 objecter
- 2018-04-17 04:35:27.538038 I | rook-ceph-mon0: 0/ 0 rados
- 2018-04-17 04:35:27.538053 I | rook-ceph-mon0: 0/ 5 rbd
- 2018-04-17 04:35:27.538071 I | rook-ceph-mon0: 0/ 5 rbd_mirror
- 2018-04-17 04:35:27.538088 I | rook-ceph-mon0: 0/ 5 rbd_replay
- 2018-04-17 04:35:27.538105 I | rook-ceph-mon0: 0/ 5 journaler
- 2018-04-17 04:35:27.538122 I | rook-ceph-mon0: 0/ 5 objectcacher
- 2018-04-17 04:35:27.538139 I | rook-ceph-mon0: 0/ 5 client
- 2018-04-17 04:35:27.538157 I | rook-ceph-mon0: 0/ 0 osd
- 2018-04-17 04:35:27.538176 I | rook-ceph-mon0: 0/ 5 optracker
- 2018-04-17 04:35:27.538194 I | rook-ceph-mon0: 0/ 5 objclass
- 2018-04-17 04:35:27.538213 I | rook-ceph-mon0: 0/ 0 filestore
- 2018-04-17 04:35:27.538231 I | rook-ceph-mon0: 0/ 0 journal
- 2018-04-17 04:35:27.538248 I | rook-ceph-mon0: 0/ 5 ms
- 2018-04-17 04:35:27.538272 I | rook-ceph-mon0: 0/ 0 mon
- 2018-04-17 04:35:27.538290 I | rook-ceph-mon0: 0/10 monc
- 2018-04-17 04:35:27.538317 I | rook-ceph-mon0: 1/ 5 paxos
- 2018-04-17 04:35:27.538336 I | rook-ceph-mon0: 0/ 5 tp
- 2018-04-17 04:35:27.538362 I | rook-ceph-mon0: 1/ 5 auth
- 2018-04-17 04:35:27.538387 I | rook-ceph-mon0: 1/ 5 crypto
- 2018-04-17 04:35:27.538412 I | rook-ceph-mon0: 1/ 1 finisher
- 2018-04-17 04:35:27.538438 I | rook-ceph-mon0: 1/ 1 reserver
- 2018-04-17 04:35:27.538462 I | rook-ceph-mon0: 1/ 5 heartbeatmap
- 2018-04-17 04:35:27.538488 I | rook-ceph-mon0: 1/ 5 perfcounter
- 2018-04-17 04:35:27.538513 I | rook-ceph-mon0: 1/ 5 rgw
- 2018-04-17 04:35:27.538538 I | rook-ceph-mon0: 1/10 civetweb
- 2018-04-17 04:35:27.538563 I | rook-ceph-mon0: 1/ 5 javaclient
- 2018-04-17 04:35:27.538588 I | rook-ceph-mon0: 1/ 5 asok
- 2018-04-17 04:35:27.538613 I | rook-ceph-mon0: 1/ 1 throttle
- 2018-04-17 04:35:27.538638 I | rook-ceph-mon0: 0/ 0 refs
- 2018-04-17 04:35:27.538663 I | rook-ceph-mon0: 1/ 5 xio
- 2018-04-17 04:35:27.538712 I | rook-ceph-mon0: 1/ 5 compressor
- 2018-04-17 04:35:27.538733 I | rook-ceph-mon0: 0/ 0 bluestore
- 2018-04-17 04:35:27.538750 I | rook-ceph-mon0: 1/ 5 bluefs
- 2018-04-17 04:35:27.538777 I | rook-ceph-mon0: 1/ 3 bdev
- 2018-04-17 04:35:27.538796 I | rook-ceph-mon0: 1/ 5 kstore
- 2018-04-17 04:35:27.538825 I | rook-ceph-mon0: 4/ 5 rocksdb
- 2018-04-17 04:35:27.538843 I | rook-ceph-mon0: 0/ 0 leveldb
- 2018-04-17 04:35:27.538860 I | rook-ceph-mon0: 4/ 5 memdb
- 2018-04-17 04:35:27.538877 I | rook-ceph-mon0: 1/ 5 kinetic
- 2018-04-17 04:35:27.538893 I | rook-ceph-mon0: 1/ 5 fuse
- 2018-04-17 04:35:27.538910 I | rook-ceph-mon0: 1/ 5 mgr
- 2018-04-17 04:35:27.538927 I | rook-ceph-mon0: 1/ 5 mgrc
- 2018-04-17 04:35:27.538944 I | rook-ceph-mon0: 1/ 5 dpdk
- 2018-04-17 04:35:27.538963 I | rook-ceph-mon0: 1/ 5 eventtrace
- 2018-04-17 04:35:27.539006 I | rook-ceph-mon0: -2/-2 (syslog threshold)
- 2018-04-17 04:35:27.539025 I | rook-ceph-mon0: -1/-1 (stderr threshold)
- 2018-04-17 04:35:27.539042 I | rook-ceph-mon0: max_recent 10000
- 2018-04-17 04:35:27.539072 I | rook-ceph-mon0: max_new 1000
- 2018-04-17 04:35:27.539091 I | rook-ceph-mon0: log_file /dev/stdout
- 2018-04-17 04:35:27.539119 I | rook-ceph-mon0: --- end dump of recent events ---
- 2018-04-17 04:35:27.571591 I | rook-ceph-mon0: /build/ceph-12.2.4/src/mds/FSMap.cc: In function 'void FSMap::assign_standby_replay(mds_gid_t, fs_cluster_id_t, mds_rank_t)' thread 7f382fd6f700 time 2018-04-17 04:35:27.510001
- 2018-04-17 04:35:27.571769 I | rook-ceph-mon0: /build/ceph-12.2.4/src/mds/FSMap.cc: 876: FAILED assert(mds_roles.at(standby_gid) == FS_CLUSTER_ID_NONE)
- 2018-04-17 04:35:27.571812 I | rook-ceph-mon0: ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)
- 2018-04-17 04:35:27.571829 I | rook-ceph-mon0: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x55d387221672]
- 2018-04-17 04:35:27.571842 I | rook-ceph-mon0: 2: (FSMap::assign_standby_replay(mds_gid_t, int, int)+0x457) [0x55d3874b9eb7]
- 2018-04-17 04:35:27.571856 I | rook-ceph-mon0: 3: (MDSMonitor::try_standby_replay(MDSMap::mds_info_t const&, Filesystem const&, MDSMap::mds_info_t const&)+0x222) [0x55d38719bfe2]
- 2018-04-17 04:35:27.571870 I | rook-ceph-mon0: 4: (MDSMonitor::maybe_promote_standby(std::shared_ptr<Filesystem>)+0xc7c) [0x55d3871a004c]
- 2018-04-17 04:35:27.571883 I | rook-ceph-mon0: 5: (MDSMonitor::tick()+0x8ea) [0x55d3871a6c8a]
- 2018-04-17 04:35:27.571902 I | rook-ceph-mon0: 6: (MDSMonitor::on_active()+0x28) [0x55d38719bc88]
- 2018-04-17 04:35:27.571934 I | rook-ceph-mon0: 7: (PaxosService::_active()+0x40a) [0x55d3870fb77a]
- 2018-04-17 04:35:27.571971 I | rook-ceph-mon0: 8: (Context::complete(int)+0x9) [0x55d386fd1629]
- 2018-04-17 04:35:27.572011 I | rook-ceph-mon0: 9: (void finish_contexts<Context>(CephContext*, std::__cxx11::list<Context*, std::allocator<Context*> >&, int)+0x20b) [0x55d386fdb01b]
- 2018-04-17 04:35:27.572054 I | rook-ceph-mon0: 10: (Paxos::finish_round()+0x188) [0x55d3870f3358]
- 2018-04-17 04:35:27.572082 I | rook-ceph-mon0: 11: (Paxos::handle_last(boost::intrusive_ptr<MonOpRequest>)+0xf9d) [0x55d3870f486d]
- 2018-04-17 04:35:27.572097 I | rook-ceph-mon0: 12: (Paxos::dispatch(boost::intrusive_ptr<MonOpRequest>)+0x263) [0x55d3870f51c3]
- 2018-04-17 04:35:27.572128 I | rook-ceph-mon0: 13: (Monitor::dispatch_op(boost::intrusive_ptr<MonOpRequest>)+0xefe) [0x55d386fc72ce]
- 2018-04-17 04:35:27.572146 I | rook-ceph-mon0: 14: (Monitor::_ms_dispatch(Message*)+0x6db) [0x55d386fc7e5b]
- 2018-04-17 04:35:27.572160 I | rook-ceph-mon0: 15: (Monitor::ms_dispatch(Message*)+0x23) [0x55d386ff7d93]
- 2018-04-17 04:35:27.572187 I | rook-ceph-mon0: 16: (DispatchQueue::entry()+0xf4a) [0x55d38752282a]
- 2018-04-17 04:35:27.572201 I | rook-ceph-mon0: 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x55d3872d1a8d]
- 2018-04-17 04:35:27.572223 I | rook-ceph-mon0: 18: (()+0x76ba) [0x7f3837abc6ba]
- 2018-04-17 04:35:27.572237 I | rook-ceph-mon0: 19: (clone()+0x6d) [0x7f38362e641d]
- 2018-04-17 04:35:27.572251 I | rook-ceph-mon0: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- 2018-04-17 04:35:27.572266 I | rook-ceph-mon0: 2018-04-17 04:35:27.518367 7f382fd6f700 -1 /build/ceph-12.2.4/src/mds/FSMap.cc: In function 'void FSMap::assign_standby_replay(mds_gid_t, fs_cluster_id_t, mds_rank_t)' thread 7f382fd6f700 time 2018-04-17 04:35:27.510001
- 2018-04-17 04:35:27.572279 I | rook-ceph-mon0: /build/ceph-12.2.4/src/mds/FSMap.cc: 876: FAILED assert(mds_roles.at(standby_gid) == FS_CLUSTER_ID_NONE)
- 2018-04-17 04:35:27.572292 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.572306 I | rook-ceph-mon0: ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)
- 2018-04-17 04:35:27.572334 I | rook-ceph-mon0: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x55d387221672]
- 2018-04-17 04:35:27.572350 I | rook-ceph-mon0: 2: (FSMap::assign_standby_replay(mds_gid_t, int, int)+0x457) [0x55d3874b9eb7]
- 2018-04-17 04:35:27.572364 I | rook-ceph-mon0: 3: (MDSMonitor::try_standby_replay(MDSMap::mds_info_t const&, Filesystem const&, MDSMap::mds_info_t const&)+0x222) [0x55d38719bfe2]
- 2018-04-17 04:35:27.572389 I | rook-ceph-mon0: 4: (MDSMonitor::maybe_promote_standby(std::shared_ptr<Filesystem>)+0xc7c) [0x55d3871a004c]
- 2018-04-17 04:35:27.572403 I | rook-ceph-mon0: 5: (MDSMonitor::tick()+0x8ea) [0x55d3871a6c8a]
- 2018-04-17 04:35:27.572417 I | rook-ceph-mon0: 6: (MDSMonitor::on_active()+0x28) [0x55d38719bc88]
- 2018-04-17 04:35:27.572430 I | rook-ceph-mon0: 7: (PaxosService::_active()+0x40a) [0x55d3870fb77a]
- 2018-04-17 04:35:27.572454 I | rook-ceph-mon0: 8: (Context::complete(int)+0x9) [0x55d386fd1629]
- 2018-04-17 04:35:27.572468 I | rook-ceph-mon0: 9: (void finish_contexts<Context>(CephContext*, std::__cxx11::list<Context*, std::allocator<Context*> >&, int)+0x20b) [0x55d386fdb01b]
- 2018-04-17 04:35:27.572481 I | rook-ceph-mon0: 10: (Paxos::finish_round()+0x188) [0x55d3870f3358]
- 2018-04-17 04:35:27.572504 I | rook-ceph-mon0: 11: (Paxos::handle_last(boost::intrusive_ptr<MonOpRequest>)+0xf9d) [0x55d3870f486d]
- 2018-04-17 04:35:27.572518 I | rook-ceph-mon0: 12: (Paxos::dispatch(boost::intrusive_ptr<MonOpRequest>)+0x263) [0x55d3870f51c3]
- 2018-04-17 04:35:27.572531 I | rook-ceph-mon0: 13: (Monitor::dispatch_op(boost::intrusive_ptr<MonOpRequest>)+0xefe) [0x55d386fc72ce]
- 2018-04-17 04:35:27.572550 I | rook-ceph-mon0: 14: (Monitor::_ms_dispatch(Message*)+0x6db) [0x55d386fc7e5b]
- 2018-04-17 04:35:27.572564 I | rook-ceph-mon0: 15: (Monitor::ms_dispatch(Message*)+0x23) [0x55d386ff7d93]
- 2018-04-17 04:35:27.572588 I | rook-ceph-mon0: 16: (DispatchQueue::entry()+0xf4a) [0x55d38752282a]
- 2018-04-17 04:35:27.572602 I | rook-ceph-mon0: 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x55d3872d1a8d]
- 2018-04-17 04:35:27.572617 I | rook-ceph-mon0: 18: (()+0x76ba) [0x7f3837abc6ba]
- 2018-04-17 04:35:27.572638 I | rook-ceph-mon0: 19: (clone()+0x6d) [0x7f38362e641d]
- 2018-04-17 04:35:27.572654 I | rook-ceph-mon0: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- 2018-04-17 04:35:27.572667 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.572711 I | rook-ceph-mon0: 0> 2018-04-17 04:35:27.518367 7f382fd6f700 -1 /build/ceph-12.2.4/src/mds/FSMap.cc: In function 'void FSMap::assign_standby_replay(mds_gid_t, fs_cluster_id_t, mds_rank_t)' thread 7f382fd6f700 time 2018-04-17 04:35:27.510001
- 2018-04-17 04:35:27.572735 I | rook-ceph-mon0: /build/ceph-12.2.4/src/mds/FSMap.cc: 876: FAILED assert(mds_roles.at(standby_gid) == FS_CLUSTER_ID_NONE)
- 2018-04-17 04:35:27.572749 I | rook-ceph-mon0:
- 2018-04-17 04:35:27.572768 I | rook-ceph-mon0: ceph version 12.2.4 (52085d5249a80c5f5121a76d6288429f35e4e77b) luminous (stable)
- 2018-04-17 04:35:27.572801 I | rook-ceph-mon0: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x55d387221672]
- 2018-04-17 04:35:27.572829 I | rook-ceph-mon0: 2: (FSMap::assign_standby_replay(mds_gid_t, int, int)+0x457) [0x55d3874b9eb7]
- 2018-04-17 04:35:27.572844 I | rook-ceph-mon0: 3: (MDSMonitor::try_standby_replay(MDSMap::mds_info_t const&, Filesystem const&, MDSMap::mds_info_t const&)+0x222) [0x55d38719bfe2]
- 2018-04-17 04:35:27.572857 I | rook-ceph-mon0: 4: (MDSMonitor::maybe_promote_standby(std::shared_ptr<Filesystem>)+0xc7c) [0x55d3871a004c]
- 2018-04-17 04:35:27.572884 I | rook-ceph-mon0: 5: (MDSMonitor::tick()+0x8ea) [0x55d3871a6c8a]
- 2018-04-17 04:35:27.572898 I | rook-ceph-mon0: 6: (MDSMonitor::on_active()+0x28) [0x55d38719bc88]
- 2018-04-17 04:35:27.572911 I | rook-ceph-mon0: 7: (PaxosService::_active()+0x40a) [0x55d3870fb77a]
- 2018-04-17 04:35:27.572934 I | rook-ceph-mon0: 8: (Context::complete(int)+0x9) [0x55d386fd1629]
- 2018-04-17 04:35:27.572948 I | rook-ceph-mon0: 9: (void finish_contexts<Context>(CephContext*, std::__cxx11::list<Context*, std::allocator<Context*> >&, int)+0x20b) [0x55d386fdb01b]
- 2018-04-17 04:35:27.572963 I | rook-ceph-mon0: 10: (Paxos::finish_round()+0x188) [0x55d3870f3358]
- 2018-04-17 04:35:27.572995 I | rook-ceph-mon0: 11: (Paxos::handle_last(boost::intrusive_ptr<MonOpRequest>)+0xf9d) [0x55d3870f486d]
- 2018-04-17 04:35:27.573010 I | rook-ceph-mon0: 12: (Paxos::dispatch(boost::intrusive_ptr<MonOpRequest>)+0x263) [0x55d3870f51c3]
- 2018-04-17 04:35:27.573023 I | rook-ceph-mon0: 13: (Monitor::dispatch_op(boost::intrusive_ptr<MonOpRequest>)+0xefe) [0x55d386fc72ce]
- 2018-04-17 04:35:27.573044 I | rook-ceph-mon0: 14: (Monitor::_ms_dispatch(Message*)+0x6db) [0x55d386fc7e5b]
- 2018-04-17 04:35:27.573058 I | rook-ceph-mon0: 15: (Monitor::ms_dispatch(Message*)+0x23) [0x55d386ff7d93]
- 2018-04-17 04:35:27.573071 I | rook-ceph-mon0: 16: (DispatchQueue::entry()+0xf4a) [0x55d38752282a]
- 2018-04-17 04:35:27.573085 I | rook-ceph-mon0: 17: (DispatchQueue::DispatchThread::entry()+0xd) [0x55d3872d1a8d]
- 2018-04-17 04:35:27.573106 I | rook-ceph-mon0: 18: (()+0x76ba) [0x7f3837abc6ba]
- 2018-04-17 04:35:27.573121 I | rook-ceph-mon0: 19: (clone()+0x6d) [0x7f38362e641d]
- 2018-04-17 04:35:27.573144 I | rook-ceph-mon0: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
- 2018-04-17 04:35:27.573157 I | rook-ceph-mon0:
- failed to run mon. failed to start mon: Failed to complete rook-ceph-mon0: signal: aborted (core dumped)
Add Comment
Please, Sign In to add comment