Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2018/07/27-04:05:18.678190 76f71d30 RocksDB version: 5.14.2
- 2018/07/27-04:05:18.678267 76f71d30 Git sha rocksdb_build_git_sha:f201a44b4102308b840b15d9b89122af787476f1
- 2018/07/27-04:05:18.678276 76f71d30 Compile date Jul 26 2018
- 2018/07/27-04:05:18.678283 76f71d30 DB SUMMARY
- 2018/07/27-04:05:18.678956 76f71d30 CURRENT file: CURRENT
- 2018/07/27-04:05:18.678964 76f71d30 IDENTITY file: IDENTITY
- 2018/07/27-04:05:18.679003 76f71d30 MANIFEST file: MANIFEST-002347 size: 14368 Bytes
- 2018/07/27-04:05:18.679012 76f71d30 SST files in /mnt/storage/.pin0de/electrs/mainnet dir, Total Num: 183, files: 000174.sst 000175.sst 000176.sst 000180.sst 000181.sst 000182.sst 000183.sst 000185.sst 000186.sst
- 2018/07/27-04:05:18.679019 76f71d30 Write Ahead Log file in /mnt/storage/.pin0de/electrs/mainnet: 002348.log size: 42 ;
- 2018/07/27-04:05:18.679036 76f71d30 Options.error_if_exists: 0
- 2018/07/27-04:05:18.679042 76f71d30 Options.create_if_missing: 1
- 2018/07/27-04:05:18.679047 76f71d30 Options.paranoid_checks: 1
- 2018/07/27-04:05:18.679053 76f71d30 Options.env: 0xa43bb0
- 2018/07/27-04:05:18.679059 76f71d30 Options.info_log: 0x7679e720
- 2018/07/27-04:05:18.679064 76f71d30 Options.max_file_opening_threads: 16
- 2018/07/27-04:05:18.679070 76f71d30 Options.statistics: (nil)
- 2018/07/27-04:05:18.679076 76f71d30 Options.use_fsync: 0
- 2018/07/27-04:05:18.679081 76f71d30 Options.max_log_file_size: 0
- 2018/07/27-04:05:18.679087 76f71d30 Options.max_manifest_file_size: 18446744073709551615
- 2018/07/27-04:05:18.679093 76f71d30 Options.log_file_time_to_roll: 0
- 2018/07/27-04:05:18.679099 76f71d30 Options.keep_log_file_num: 1000
- 2018/07/27-04:05:18.679104 76f71d30 Options.recycle_log_file_num: 0
- 2018/07/27-04:05:18.679110 76f71d30 Options.allow_fallocate: 1
- 2018/07/27-04:05:18.679115 76f71d30 Options.allow_mmap_reads: 0
- 2018/07/27-04:05:18.679121 76f71d30 Options.allow_mmap_writes: 0
- 2018/07/27-04:05:18.679126 76f71d30 Options.use_direct_reads: 0
- 2018/07/27-04:05:18.679132 76f71d30 Options.use_direct_io_for_flush_and_compaction: 0
- 2018/07/27-04:05:18.679137 76f71d30 Options.create_missing_column_families: 0
- 2018/07/27-04:05:18.679143 76f71d30 Options.db_log_dir:
- 2018/07/27-04:05:18.679149 76f71d30 Options.wal_dir: /mnt/storage/.pin0de/electrs/mainnet
- 2018/07/27-04:05:18.679155 76f71d30 Options.table_cache_numshardbits: 6
- 2018/07/27-04:05:18.679160 76f71d30 Options.max_subcompactions: 1
- 2018/07/27-04:05:18.679166 76f71d30 Options.max_background_flushes: -1
- 2018/07/27-04:05:18.679171 76f71d30 Options.WAL_ttl_seconds: 0
- 2018/07/27-04:05:18.679177 76f71d30 Options.WAL_size_limit_MB: 0
- 2018/07/27-04:05:18.679182 76f71d30 Options.manifest_preallocation_size: 4194304
- 2018/07/27-04:05:18.679188 76f71d30 Options.is_fd_close_on_exec: 1
- 2018/07/27-04:05:18.679193 76f71d30 Options.advise_random_on_open: 1
- 2018/07/27-04:05:18.679199 76f71d30 Options.db_write_buffer_size: 0
- 2018/07/27-04:05:18.679204 76f71d30 Options.write_buffer_manager: 0x767ab9a0
- 2018/07/27-04:05:18.679210 76f71d30 Options.access_hint_on_compaction_start: 1
- 2018/07/27-04:05:18.679215 76f71d30 Options.new_table_reader_for_compaction_inputs: 1
- 2018/07/27-04:05:18.679220 76f71d30 Options.random_access_max_buffer_size: 1048576
- 2018/07/27-04:05:18.679226 76f71d30 Options.use_adaptive_mutex: 0
- 2018/07/27-04:05:18.679231 76f71d30 Options.rate_limiter: (nil)
- 2018/07/27-04:05:18.679237 76f71d30 Options.sst_file_manager.rate_bytes_per_sec: 0
- 2018/07/27-04:05:18.679275 76f71d30 Options.wal_recovery_mode: 2
- 2018/07/27-04:05:18.679282 76f71d30 Options.enable_thread_tracking: 0
- 2018/07/27-04:05:18.679288 76f71d30 Options.enable_pipelined_write: 0
- 2018/07/27-04:05:18.679293 76f71d30 Options.allow_concurrent_memtable_write: 1
- 2018/07/27-04:05:18.679298 76f71d30 Options.enable_write_thread_adaptive_yield: 1
- 2018/07/27-04:05:18.679304 76f71d30 Options.write_thread_max_yield_usec: 100
- 2018/07/27-04:05:18.679309 76f71d30 Options.write_thread_slow_yield_usec: 3
- 2018/07/27-04:05:18.679315 76f71d30 Options.row_cache: None
- 2018/07/27-04:05:18.679320 76f71d30 Options.wal_filter: None
- 2018/07/27-04:05:18.679326 76f71d30 Options.avoid_flush_during_recovery: 0
- 2018/07/27-04:05:18.679331 76f71d30 Options.allow_ingest_behind: 0
- 2018/07/27-04:05:18.679337 76f71d30 Options.preserve_deletes: 0
- 2018/07/27-04:05:18.679342 76f71d30 Options.two_write_queues: 0
- 2018/07/27-04:05:18.679347 76f71d30 Options.manual_wal_flush: 0
- 2018/07/27-04:05:18.679353 76f71d30 Options.max_background_jobs: 2
- 2018/07/27-04:05:18.679358 76f71d30 Options.max_background_compactions: -1
- 2018/07/27-04:05:18.679363 76f71d30 Options.avoid_flush_during_shutdown: 0
- 2018/07/27-04:05:18.679369 76f71d30 Options.writable_file_max_buffer_size: 1048576
- 2018/07/27-04:05:18.679374 76f71d30 Options.delayed_write_rate : 16777216
- 2018/07/27-04:05:18.679380 76f71d30 Options.max_total_wal_size: 0
- 2018/07/27-04:05:18.679385 76f71d30 Options.delete_obsolete_files_period_micros: 21600000000
- 2018/07/27-04:05:18.679391 76f71d30 Options.stats_dump_period_sec: 600
- 2018/07/27-04:05:18.679396 76f71d30 Options.max_open_files: 2048
- 2018/07/27-04:05:18.679403 76f71d30 Options.bytes_per_sync: 0
- 2018/07/27-04:05:18.679409 76f71d30 Options.wal_bytes_per_sync: 0
- 2018/07/27-04:05:18.679414 76f71d30 Options.compaction_readahead_size: 2097152
- 2018/07/27-04:05:18.679420 76f71d30 Compression algorithms supported:
- 2018/07/27-04:05:18.679426 76f71d30 kZSTD supported: 0
- 2018/07/27-04:05:18.679431 76f71d30 kZSTDNotFinalCompression supported: 0
- 2018/07/27-04:05:18.679437 76f71d30 kXpressCompression supported: 0
- 2018/07/27-04:05:18.679443 76f71d30 kLZ4HCCompression supported: 0
- 2018/07/27-04:05:18.679449 76f71d30 kLZ4Compression supported: 0
- 2018/07/27-04:05:18.679454 76f71d30 kZlibCompression supported: 0
- 2018/07/27-04:05:18.679460 76f71d30 kSnappyCompression supported: 1
- 2018/07/27-04:05:18.679466 76f71d30 kBZip2Compression supported: 0
- 2018/07/27-04:05:18.679474 76f71d30 Fast CRC32 supported: Not supported on x86
- 2018/07/27-04:05:18.680094 76f71d30 [rocksdb/db/version_set.cc:3085] Recovering from manifest file: MANIFEST-002347
- 2018/07/27-04:05:18.680386 76f71d30 [rocksdb/db/column_family.cc:475] --------------- Options for column family [default]:
- 2018/07/27-04:05:18.680394 76f71d30 Options.comparator: leveldb.BytewiseComparator
- 2018/07/27-04:05:18.680401 76f71d30 Options.merge_operator: None
- 2018/07/27-04:05:18.680407 76f71d30 Options.compaction_filter: None
- 2018/07/27-04:05:18.680412 76f71d30 Options.compaction_filter_factory: None
- 2018/07/27-04:05:18.680418 76f71d30 Options.memtable_factory: SkipListFactory
- 2018/07/27-04:05:18.680423 76f71d30 Options.table_factory: BlockBasedTable
- 2018/07/27-04:05:18.680495 76f71d30 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x766e6130)
- cache_index_and_filter_blocks: 0
- cache_index_and_filter_blocks_with_high_priority: 0
- pin_l0_filter_and_index_blocks_in_cache: 0
- index_type: 0
- hash_index_allow_collision: 1
- checksum: 1
- no_block_cache: 0
- block_cache: 0x766657e0
- block_cache_name: LRUCache
- block_cache_options:
- capacity : 8388608
- num_shard_bits : 4
- strict_capacity_limit : 0
- high_pri_pool_ratio: 0.000
- block_cache_compressed: (nil)
- persistent_cache: (nil)
- block_size: 4096
- block_size_deviation: 10
- block_restart_interval: 16
- index_block_restart_interval: 1
- metadata_block_size: 4096
- partition_filters: 0
- use_delta_encoding: 1
- filter_policy: nullptr
- whole_key_filtering: 1
- verify_compression: 0
- read_amp_bytes_per_bit: 0
- format_version: 2
- enable_index_compression: 1
- block_align: 0
- 2018/07/27-04:05:18.680540 76f71d30 Options.write_buffer_size: 67108864
- 2018/07/27-04:05:18.680548 76f71d30 Options.max_write_buffer_number: 3
- 2018/07/27-04:05:18.680554 76f71d30 Options.compression: Snappy
- 2018/07/27-04:05:18.680559 76f71d30 Options.bottommost_compression: Disabled
- 2018/07/27-04:05:18.680565 76f71d30 Options.prefix_extractor: nullptr
- 2018/07/27-04:05:18.680570 76f71d30 Options.memtable_insert_with_hint_prefix_extractor: nullptr
- 2018/07/27-04:05:18.680576 76f71d30 Options.num_levels: 7
- 2018/07/27-04:05:18.680581 76f71d30 Options.min_write_buffer_number_to_merge: 2
- 2018/07/27-04:05:18.680586 76f71d30 Options.max_write_buffer_number_to_maintain: 0
- 2018/07/27-04:05:18.680591 76f71d30 Options.compression_opts.window_bits: -14
- 2018/07/27-04:05:18.680597 76f71d30 Options.compression_opts.level: -1
- 2018/07/27-04:05:18.680602 76f71d30 Options.compression_opts.strategy: 0
- 2018/07/27-04:05:18.680608 76f71d30 Options.compression_opts.max_dict_bytes: 0
- 2018/07/27-04:05:18.680613 76f71d30 Options.compression_opts.zstd_max_train_bytes: 0
- 2018/07/27-04:05:18.680618 76f71d30 Options.level0_file_num_compaction_trigger: 4
- 2018/07/27-04:05:18.680624 76f71d30 Options.level0_slowdown_writes_trigger: 20
- 2018/07/27-04:05:18.680629 76f71d30 Options.level0_stop_writes_trigger: 36
- 2018/07/27-04:05:18.680634 76f71d30 Options.target_file_size_base: 134217728
- 2018/07/27-04:05:18.680640 76f71d30 Options.target_file_size_multiplier: 1
- 2018/07/27-04:05:18.680645 76f71d30 Options.max_bytes_for_level_base: 268435456
- 2018/07/27-04:05:18.680652 76f71d30 Options.level_compaction_dynamic_level_bytes: 0
- 2018/07/27-04:05:18.680657 76f71d30 Options.max_bytes_for_level_multiplier: 10.000000
- 2018/07/27-04:05:18.680668 76f71d30 Options.max_bytes_for_level_multiplier_addtl[0]: 1
- 2018/07/27-04:05:18.680674 76f71d30 Options.max_bytes_for_level_multiplier_addtl[1]: 1
- 2018/07/27-04:05:18.680679 76f71d30 Options.max_bytes_for_level_multiplier_addtl[2]: 1
- 2018/07/27-04:05:18.680685 76f71d30 Options.max_bytes_for_level_multiplier_addtl[3]: 1
- 2018/07/27-04:05:18.680701 76f71d30 Options.max_bytes_for_level_multiplier_addtl[4]: 1
- 2018/07/27-04:05:18.680707 76f71d30 Options.max_bytes_for_level_multiplier_addtl[5]: 1
- 2018/07/27-04:05:18.680713 76f71d30 Options.max_bytes_for_level_multiplier_addtl[6]: 1
- 2018/07/27-04:05:18.680718 76f71d30 Options.max_sequential_skip_in_iterations: 8
- 2018/07/27-04:05:18.680748 76f71d30 Options.max_compaction_bytes: 3355443200
- 2018/07/27-04:05:18.680754 76f71d30 Options.arena_block_size: 8388608
- 2018/07/27-04:05:18.680760 76f71d30 Options.soft_pending_compaction_bytes_limit: 68719476736
- 2018/07/27-04:05:18.680775 76f71d30 Options.hard_pending_compaction_bytes_limit: 274877906944
- 2018/07/27-04:05:18.680782 76f71d30 Options.rate_limit_delay_max_milliseconds: 100
- 2018/07/27-04:05:18.680787 76f71d30 Options.disable_auto_compactions: 0
- 2018/07/27-04:05:18.680803 76f71d30 Options.compaction_style: kCompactionStyleLevel
- 2018/07/27-04:05:18.680810 76f71d30 Options.compaction_pri: kByCompensatedSize
- 2018/07/27-04:05:18.680816 76f71d30 Options.compaction_options_universal.size_ratio: 1
- 2018/07/27-04:05:18.680821 76f71d30 Options.compaction_options_universal.min_merge_width: 2
- 2018/07/27-04:05:18.680827 76f71d30 Options.compaction_options_universal.max_merge_width: 4294967295
- 2018/07/27-04:05:18.680874 76f71d30 Options.compaction_options_universal.max_size_amplification_percent: 200
- 2018/07/27-04:05:18.680890 76f71d30 Options.compaction_options_universal.compression_size_percent: -1
- 2018/07/27-04:05:18.680899 76f71d30 Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize
- 2018/07/27-04:05:18.680905 76f71d30 Options.compaction_options_fifo.max_table_files_size: 1073741824
- 2018/07/27-04:05:18.680911 76f71d30 Options.compaction_options_fifo.allow_compaction: 0
- 2018/07/27-04:05:18.680916 76f71d30 Options.compaction_options_fifo.ttl: 0
- 2018/07/27-04:05:18.680922 76f71d30 Options.table_properties_collectors:
- 2018/07/27-04:05:18.680928 76f71d30 Options.inplace_update_support: 0
- 2018/07/27-04:05:18.680933 76f71d30 Options.inplace_update_num_locks: 10000
- 2018/07/27-04:05:18.680939 76f71d30 Options.memtable_prefix_bloom_size_ratio: 0.000000
- 2018/07/27-04:05:18.680946 76f71d30 Options.memtable_huge_page_size: 0
- 2018/07/27-04:05:18.680957 76f71d30 Options.bloom_locality: 0
- 2018/07/27-04:05:18.680963 76f71d30 Options.max_successive_merges: 0
- 2018/07/27-04:05:18.680976 76f71d30 Options.optimize_filters_for_hits: 0
- 2018/07/27-04:05:18.680982 76f71d30 Options.paranoid_file_checks: 0
- 2018/07/27-04:05:18.680987 76f71d30 Options.force_consistency_checks: 0
- 2018/07/27-04:05:18.681001 76f71d30 Options.report_bg_io_stats: 0
- 2018/07/27-04:05:18.681007 76f71d30 Options.ttl: 2124316716
- 2018/07/27-04:05:18.690181 76f71d30 [rocksdb/db/version_set.cc:3361] Recovered from manifest file:/mnt/storage/.pin0de/electrs/mainnet/MANIFEST-002347 succeeded,manifest_file_number is 2347, next_file_number is 2349, last_sequence is 1181120271, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0
- 2018/07/27-04:05:18.690199 76f71d30 [rocksdb/db/version_set.cc:3369] Column family [default] (ID 0), log number is 2346
- 2018/07/27-04:05:18.693093 76f71d30 EVENT_LOG_v1 {"time_micros": 1532664318693067, "job": 1, "event": "recovery_started", "log_files": [2348]}
- 2018/07/27-04:05:18.693113 76f71d30 [rocksdb/db/db_impl_open.cc:551] Recovering log #2348 mode 2
- 2018/07/27-04:05:18.697342 76f71d30 EVENT_LOG_v1 {"time_micros": 1532664318697295, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 2349, "file_size": 949, "table_properties": {"data_size": 25, "index_size": 27, "filter_size": 0, "raw_key_size": 9, "raw_average_key_size": 9, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 1, "num_entries": 1, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:05:18.697505 76f71d30 [rocksdb/db/version_set.cc:2847] Creating manifest 2350
- 2018/07/27-04:05:18.704870 76f71d30 EVENT_LOG_v1 {"time_micros": 1532664318704848, "job": 1, "event": "recovery_finished"}
- 2018/07/27-04:05:18.705300 76f71d30 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44449847273
- 2018/07/27-04:05:18.724103 76f71d30 [rocksdb/db/db_impl_open.cc:1219] DB pointer 0x766efe00
- 2018/07/27-04:05:18.724837 741ff390 [WARN] [rocksdb/db/db_impl.cc:491] ------- DUMPING STATS -------
- 2018/07/27-04:05:18.724941 741ff390 [WARN] [rocksdb/db/db_impl.cc:492]
- ** DB Stats **
- Uptime(secs): 0.0 total, 0.0 interval
- Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s
- Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
- Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s
- Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
- Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- ** Compaction Stats [default] **
- Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- ----------------------------------------------------------------------------------------------------------------------------------------------------------
- L0 4/0 180.82 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.2 0 1 0.004 0 0
- L1 39/0 4.66 GB 18.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L2 118/0 14.21 GB 5.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L3 23/0 2.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Sum 184/0 21.59 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.2 0 1 0.004 0 0
- Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.2 0 1 0.004 0 0
- Uptime(secs): 0.0 total, 0.0 interval
- Flush(GB): cumulative 0.000, interval 0.000
- AddFile(GB): cumulative 0.000, interval 0.000
- AddFile(Total Files): cumulative 0, interval 0
- AddFile(L0 Files): cumulative 0, interval 0
- AddFile(Keys): cumulative 0, interval 0
- Cumulative compaction: 0.00 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- Interval compaction: 0.00 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- ** File Read Latency Histogram By Level [default] **
- ** Compaction Stats [default] **
- Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- ----------------------------------------------------------------------------------------------------------------------------------------------------------
- L0 4/0 180.82 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.2 0 1 0.004 0 0
- L1 39/0 4.66 GB 18.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L2 118/0 14.21 GB 5.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L3 23/0 2.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Sum 184/0 21.59 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.2 0 1 0.004 0 0
- Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Uptime(secs): 0.0 total, 0.0 interval
- Flush(GB): cumulative 0.000, interval 0.000
- AddFile(GB): cumulative 0.000, interval 0.000
- AddFile(Total Files): cumulative 0, interval 0
- AddFile(L0 Files): cumulative 0, interval 0
- AddFile(Keys): cumulative 0, interval 0
- Cumulative compaction: 0.00 GB write, 0.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- ** File Read Latency Histogram By Level [default] **
- 2018/07/27-04:05:18.725223 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 3] Compacting 1@1 + 4@2 files to L2, score 18.63
- 2018/07/27-04:05:18.725248 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 2 Base level 1, inputs: [2306(128MB)], [2151(97MB) 1884(128MB) 1886(128MB) 1887(128MB)]
- 2018/07/27-04:05:18.725408 741ff390 EVENT_LOG_v1 {"time_micros": 1532664318725302, "job": 3, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2306], "files_L2": [2151, 1884, 1886, 1887], "score": 18.6341, "input_data_size": 641948276}
- 2018/07/27-04:05:48.148889 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 3] Generated table #2354: 6870539 keys, 135015454 bytes
- 2018/07/27-04:05:48.149149 741ff390 EVENT_LOG_v1 {"time_micros": 1532664348149065, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 2354, "file_size": 135015454, "table_properties": {"data_size": 134219170, "index_size": 1161236, "filter_size": 0, "raw_key_size": 185504553, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39753, "num_entries": 6870539, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:06:23.561786 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 3] Generated table #2355: 6859914 keys, 135013821 bytes
- 2018/07/27-04:06:23.595893 741ff390 EVENT_LOG_v1 {"time_micros": 1532664383595755, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 2355, "file_size": 135013821, "table_properties": {"data_size": 134219494, "index_size": 1160787, "filter_size": 0, "raw_key_size": 185217678, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39739, "num_entries": 6859914, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:07:00.113848 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 3] Generated table #2356: 6846624 keys, 135010092 bytes
- 2018/07/27-04:07:00.114329 741ff390 EVENT_LOG_v1 {"time_micros": 1532664420114169, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 2356, "file_size": 135010092, "table_properties": {"data_size": 134219968, "index_size": 1158112, "filter_size": 0, "raw_key_size": 184858848, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39694, "num_entries": 6846624, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:07:38.144796 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 3] Generated table #2357: 6847023 keys, 135010528 bytes
- 2018/07/27-04:07:38.174251 741ff390 EVENT_LOG_v1 {"time_micros": 1532664458174000, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 2357, "file_size": 135010528, "table_properties": {"data_size": 134219298, "index_size": 1159070, "filter_size": 0, "raw_key_size": 184869621, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39712, "num_entries": 6847023, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:08:03.757903 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 3] Generated table #2358: 4877200 keys, 96004573 bytes
- 2018/07/27-04:08:03.856291 741ff390 EVENT_LOG_v1 {"time_micros": 1532664483856197, "cf_name": "default", "job": 3, "event": "table_file_creation", "file_number": 2358, "file_size": 96004573, "table_properties": {"data_size": 95440227, "index_size": 824809, "filter_size": 0, "raw_key_size": 131684400, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 28260, "num_entries": 4877200, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:08:03.858571 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 3] Compacted 1@1 + 4@2 files to L2 => 636054468 bytes
- 2018/07/27-04:08:03.869813 741ff390 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44275056707
- 2018/07/27-04:08:03.869963 741ff390 (Original Log Time 2018/07/27-04:08:03.869680) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[4 38 119 23 0 0 0] max score 18.13, MB/sec: 3.9 rd, 3.9 wr, level 2, files in(1, 4) out(5) MB in(128.7, 483.5) out(606.6), read-write-amplify(9.5) write-amplify(4.7) OK, records in: 6524107, records dropped: 0 output_compression: Snappy
- 2018/07/27-04:08:03.869992 741ff390 (Original Log Time 2018/07/27-04:08:03.869796) EVENT_LOG_v1 {"time_micros": 1532664483869733, "job": 3, "event": "compaction_finished", "compaction_time_micros": 165133003, "output_level": 2, "num_output_files": 5, "total_output_size": 636054468, "num_input_records": 32301300, "num_output_records": 32301300, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [4, 38, 119, 23, 0, 0, 0]}
- 2018/07/27-04:08:03.924166 741ff390 EVENT_LOG_v1 {"time_micros": 1532664483924137, "job": 3, "event": "table_file_deletion", "file_number": 2306}
- 2018/07/27-04:08:03.963455 741ff390 EVENT_LOG_v1 {"time_micros": 1532664483963426, "job": 3, "event": "table_file_deletion", "file_number": 2151}
- 2018/07/27-04:08:04.000570 741ff390 EVENT_LOG_v1 {"time_micros": 1532664484000542, "job": 3, "event": "table_file_deletion", "file_number": 1887}
- 2018/07/27-04:08:04.023615 741ff390 EVENT_LOG_v1 {"time_micros": 1532664484023586, "job": 3, "event": "table_file_deletion", "file_number": 1886}
- 2018/07/27-04:08:04.036632 741ff390 EVENT_LOG_v1 {"time_micros": 1532664484036597, "job": 3, "event": "table_file_deletion", "file_number": 1884}
- 2018/07/27-04:08:04.037181 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 4] Compacting 1@1 + 6@2 files to L2, score 18.13
- 2018/07/27-04:08:04.037244 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 3 Base level 1, inputs: [2307(128MB)], [2358(91MB) 2092(128MB) 2093(128MB) 2096(128MB) 2097(128MB) 2099(128MB)]
- 2018/07/27-04:08:04.037352 741ff390 EVENT_LOG_v1 {"time_micros": 1532664484037286, "job": 4, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2307], "files_L2": [2358, 2092, 2093, 2096, 2097, 2099], "score": 18.1312, "input_data_size": 906048890}
- 2018/07/27-04:08:38.319077 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 4] Generated table #2359: 6851570 keys, 135010730 bytes
- 2018/07/27-04:08:38.390661 741ff390 EVENT_LOG_v1 {"time_micros": 1532664518390552, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 2359, "file_size": 135010730, "table_properties": {"data_size": 134219797, "index_size": 1159233, "filter_size": 0, "raw_key_size": 184992390, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39718, "num_entries": 6851570, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:09:17.198789 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 4] Generated table #2360: 6867004 keys, 135014484 bytes
- 2018/07/27-04:09:17.312666 741ff390 EVENT_LOG_v1 {"time_micros": 1532664557312560, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 2360, "file_size": 135014484, "table_properties": {"data_size": 134219660, "index_size": 1160630, "filter_size": 0, "raw_key_size": 185409108, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39758, "num_entries": 6867004, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:09:38.985934 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2362. Immutable memtables: 0.
- 2018/07/27-04:09:39.012267 76f71d30 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44275056707
- 2018/07/27-04:09:52.569473 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 4] Generated table #2361: 6853770 keys, 135014890 bytes
- 2018/07/27-04:09:52.648073 741ff390 EVENT_LOG_v1 {"time_micros": 1532664592647973, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 2361, "file_size": 135014890, "table_properties": {"data_size": 134220916, "index_size": 1158425, "filter_size": 0, "raw_key_size": 185051790, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39723, "num_entries": 6853770, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:10:22.197305 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 4] Generated table #2363: 6845192 keys, 135008411 bytes
- 2018/07/27-04:10:22.243409 741ff390 EVENT_LOG_v1 {"time_micros": 1532664622243316, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 2363, "file_size": 135008411, "table_properties": {"data_size": 134217982, "index_size": 1157963, "filter_size": 0, "raw_key_size": 184820184, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39689, "num_entries": 6845192, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:10:53.242437 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 4] Generated table #2364: 6847560 keys, 135010512 bytes
- 2018/07/27-04:10:53.283687 741ff390 EVENT_LOG_v1 {"time_micros": 1532664653283586, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 2364, "file_size": 135010512, "table_properties": {"data_size": 134218686, "index_size": 1160185, "filter_size": 0, "raw_key_size": 184884120, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39708, "num_entries": 6847560, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:11:01.882037 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2366. Immutable memtables: 1.
- 2018/07/27-04:11:01.965456 76f71d30 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44275056707
- 2018/07/27-04:11:13.845229 739fe390 (Original Log Time 2018/07/27-04:11:01.997238) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:11:14.015419 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 5] Flushing memtable with next log file: 2362
- 2018/07/27-04:11:14.104639 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 5] Flushing memtable with next log file: 2366
- 2018/07/27-04:11:14.132741 739fe390 EVENT_LOG_v1 {"time_micros": 1532664674130255, "job": 5, "event": "flush_started", "num_memtables": 2, "num_entries": 3948067, "num_deletes": 0, "memory_usage": 156682008, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:11:14.132791 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 5] Level-0 flush table #2367: started
- 2018/07/27-04:11:34.180422 739fe390 EVENT_LOG_v1 {"time_micros": 1532664694180308, "cf_name": "default", "job": 5, "event": "table_file_creation", "file_number": 2367, "file_size": 96607205, "table_properties": {"data_size": 96120702, "index_size": 713724, "filter_size": 0, "raw_key_size": 112007102, "raw_average_key_size": 28, "raw_value_size": 2620896, "raw_average_value_size": 0, "num_data_blocks": 26772, "num_entries": 3941946, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:11:34.198673 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 5] Level-0 flush table #2367: 96607205 bytes OK
- 2018/07/27-04:11:34.309698 739fe390 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44581924817
- 2018/07/27-04:11:34.309893 739fe390 (Original Log Time 2018/07/27-04:11:34.218034) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2367 started
- 2018/07/27-04:11:34.309904 739fe390 (Original Log Time 2018/07/27-04:11:34.309572) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2367: memtable #1 done
- 2018/07/27-04:11:34.309912 739fe390 (Original Log Time 2018/07/27-04:11:34.309586) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2367: memtable #2 done
- 2018/07/27-04:11:34.309921 739fe390 (Original Log Time 2018/07/27-04:11:34.309654) EVENT_LOG_v1 {"time_micros": 1532664694309620, "job": 5, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [5, 38, 119, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:11:34.309929 739fe390 (Original Log Time 2018/07/27-04:11:34.309819) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[5 38 119 23 0 0 0] max score 17.63
- 2018/07/27-04:11:34.310093 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 5] Try to delete WAL files size 95048732, prev total WAL file size 115493800, number of live WAL files 3.
- 2018/07/27-04:11:34.775415 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 4] Generated table #2365: 6845914 keys, 135012462 bytes
- 2018/07/27-04:11:34.775540 741ff390 EVENT_LOG_v1 {"time_micros": 1532664694775467, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 2365, "file_size": 135012462, "table_properties": {"data_size": 134220182, "index_size": 1159345, "filter_size": 0, "raw_key_size": 184839678, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39699, "num_entries": 6845914, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:11:57.285347 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 4] Generated table #2368: 4465181 keys, 87969621 bytes
- 2018/07/27-04:11:57.301513 741ff390 EVENT_LOG_v1 {"time_micros": 1532664717301411, "cf_name": "default", "job": 4, "event": "table_file_creation", "file_number": 2368, "file_size": 87969621, "table_properties": {"data_size": 87453530, "index_size": 755094, "filter_size": 0, "raw_key_size": 120559887, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 25880, "num_entries": 4465181, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:11:57.328947 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 4] Compacted 1@1 + 6@2 files to L2 => 898041110 bytes
- 2018/07/27-04:11:57.357776 741ff390 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44402445803
- 2018/07/27-04:11:57.357958 741ff390 (Original Log Time 2018/07/27-04:11:57.357623) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[5 37 120 23 0 0 0] max score 17.63, MB/sec: 3.9 rd, 3.8 wr, level 2, files in(1, 6) out(7) MB in(128.7, 735.4) out(856.4), read-write-amplify(13.4) write-amplify(6.7) OK, records in: 11257159, records dropped: 0 output_compression: Snappy
- 2018/07/27-04:11:57.357987 741ff390 (Original Log Time 2018/07/27-04:11:57.357752) EVENT_LOG_v1 {"time_micros": 1532664717357688, "job": 4, "event": "compaction_finished", "compaction_time_micros": 233291057, "output_level": 2, "num_output_files": 7, "total_output_size": 898041110, "num_input_records": 45576191, "num_output_records": 45576191, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [5, 37, 120, 23, 0, 0, 0]}
- 2018/07/27-04:11:57.378709 741ff390 EVENT_LOG_v1 {"time_micros": 1532664717378679, "job": 4, "event": "table_file_deletion", "file_number": 2358}
- 2018/07/27-04:11:57.411854 741ff390 EVENT_LOG_v1 {"time_micros": 1532664717411825, "job": 4, "event": "table_file_deletion", "file_number": 2307}
- 2018/07/27-04:11:57.517516 741ff390 EVENT_LOG_v1 {"time_micros": 1532664717517487, "job": 4, "event": "table_file_deletion", "file_number": 2099}
- 2018/07/27-04:11:57.528134 741ff390 EVENT_LOG_v1 {"time_micros": 1532664717528106, "job": 4, "event": "table_file_deletion", "file_number": 2097}
- 2018/07/27-04:11:57.528753 741ff390 EVENT_LOG_v1 {"time_micros": 1532664717528735, "job": 4, "event": "table_file_deletion", "file_number": 2096}
- 2018/07/27-04:11:57.547176 741ff390 EVENT_LOG_v1 {"time_micros": 1532664717547148, "job": 4, "event": "table_file_deletion", "file_number": 2093}
- 2018/07/27-04:11:57.575416 741ff390 EVENT_LOG_v1 {"time_micros": 1532664717575386, "job": 4, "event": "table_file_deletion", "file_number": 2092}
- 2018/07/27-04:11:57.575849 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 6] Compacting 1@1 + 7@2 files to L2, score 17.63
- 2018/07/27-04:11:57.575892 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 5 Base level 1, inputs: [2303(128MB)], [2161(128MB) 2163(122MB) 2104(128MB) 2106(128MB) 2107(128MB) 2110(128MB) 2111(128MB)]
- 2018/07/27-04:11:57.585619 741ff390 EVENT_LOG_v1 {"time_micros": 1532664717575915, "job": 6, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2303], "files_L2": [2161, 2163, 2104, 2106, 2107, 2110, 2111], "score": 17.6284, "input_data_size": 1073192933}
- 2018/07/27-04:12:18.535556 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2370. Immutable memtables: 0.
- 2018/07/27-04:12:18.599051 76f71d30 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44402445803
- 2018/07/27-04:12:29.409147 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 6] Generated table #2369: 6866844 keys, 135013990 bytes
- 2018/07/27-04:12:29.513801 741ff390 EVENT_LOG_v1 {"time_micros": 1532664749513710, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 2369, "file_size": 135013990, "table_properties": {"data_size": 134219036, "index_size": 1160218, "filter_size": 0, "raw_key_size": 185404788, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39747, "num_entries": 6866844, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:13:01.155033 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 6] Generated table #2371: 6850895 keys, 135009100 bytes
- 2018/07/27-04:13:01.196171 741ff390 EVENT_LOG_v1 {"time_micros": 1532664781196059, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 2371, "file_size": 135009100, "table_properties": {"data_size": 134218103, "index_size": 1159013, "filter_size": 0, "raw_key_size": 184974165, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39720, "num_entries": 6850895, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:13:37.446196 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2373. Immutable memtables: 1.
- 2018/07/27-04:13:37.497869 76f71d30 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44402445803
- 2018/07/27-04:13:42.495674 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 6] Generated table #2372: 6857012 keys, 135009417 bytes
- 2018/07/27-04:13:42.496044 741ff390 EVENT_LOG_v1 {"time_micros": 1532664822495941, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 2372, "file_size": 135009417, "table_properties": {"data_size": 134217924, "index_size": 1160195, "filter_size": 0, "raw_key_size": 185139324, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39743, "num_entries": 6857012, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:13:46.046658 739fe390 (Original Log Time 2018/07/27-04:13:37.498124) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:13:46.046685 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 7] Flushing memtable with next log file: 2370
- 2018/07/27-04:13:46.046706 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 7] Flushing memtable with next log file: 2373
- 2018/07/27-04:13:46.046783 739fe390 EVENT_LOG_v1 {"time_micros": 1532664826046748, "job": 7, "event": "flush_started", "num_memtables": 2, "num_entries": 3587903, "num_deletes": 0, "memory_usage": 144085980, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:13:46.063720 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 7] Level-0 flush table #2374: started
- 2018/07/27-04:14:02.259445 739fe390 EVENT_LOG_v1 {"time_micros": 1532664842259350, "cf_name": "default", "job": 7, "event": "table_file_creation", "file_number": 2374, "file_size": 89506230, "table_properties": {"data_size": 89062578, "index_size": 652904, "filter_size": 0, "raw_key_size": 102422082, "raw_average_key_size": 28, "raw_value_size": 2522712, "raw_average_value_size": 0, "num_data_blocks": 24649, "num_entries": 3584210, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:14:02.313403 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 7] Level-0 flush table #2374: 89506230 bytes OK
- 2018/07/27-04:14:02.348904 739fe390 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44687099282
- 2018/07/27-04:14:02.349037 739fe390 (Original Log Time 2018/07/27-04:14:02.314116) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2374 started
- 2018/07/27-04:14:02.349048 739fe390 (Original Log Time 2018/07/27-04:14:02.348781) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2374: memtable #1 done
- 2018/07/27-04:14:02.349057 739fe390 (Original Log Time 2018/07/27-04:14:02.348795) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2374: memtable #2 done
- 2018/07/27-04:14:02.349066 739fe390 (Original Log Time 2018/07/27-04:14:02.348883) EVENT_LOG_v1 {"time_micros": 1532664842348832, "job": 7, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [6, 37, 120, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:14:02.349074 739fe390 (Original Log Time 2018/07/27-04:14:02.348977) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[6 37 120 23 0 0 0] max score 17.13
- 2018/07/27-04:14:02.349284 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 7] Try to delete WAL files size 87104036, prev total WAL file size 107981614, number of live WAL files 3.
- 2018/07/27-04:14:19.698410 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 6] Generated table #2375: 6845642 keys, 135011550 bytes
- 2018/07/27-04:14:19.698631 741ff390 EVENT_LOG_v1 {"time_micros": 1532664859698556, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 2375, "file_size": 135011550, "table_properties": {"data_size": 134220459, "index_size": 1158510, "filter_size": 0, "raw_key_size": 184832334, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39706, "num_entries": 6845642, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:14:51.003681 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2377. Immutable memtables: 0.
- 2018/07/27-04:14:51.111070 76f71d30 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44687099282
- 2018/07/27-04:14:52.355656 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 6] Generated table #2376: 6848040 keys, 135010182 bytes
- 2018/07/27-04:14:52.355795 741ff390 EVENT_LOG_v1 {"time_micros": 1532664892355714, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 2376, "file_size": 135010182, "table_properties": {"data_size": 134219819, "index_size": 1158683, "filter_size": 0, "raw_key_size": 184897080, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39704, "num_entries": 6848040, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:15:23.501470 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 6] Generated table #2378: 6840248 keys, 135011642 bytes
- 2018/07/27-04:15:23.523026 741ff390 EVENT_LOG_v1 {"time_micros": 1532664923522923, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 2378, "file_size": 135011642, "table_properties": {"data_size": 134221126, "index_size": 1157722, "filter_size": 0, "raw_key_size": 184686696, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39689, "num_entries": 6840248, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:15:52.587069 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2380. Immutable memtables: 1.
- 2018/07/27-04:15:52.692327 76f71d30 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44687099282
- 2018/07/27-04:15:56.543201 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 6] Generated table #2379: 6841877 keys, 135010243 bytes
- 2018/07/27-04:15:56.543353 741ff390 EVENT_LOG_v1 {"time_micros": 1532664956543268, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 2379, "file_size": 135010243, "table_properties": {"data_size": 134219218, "index_size": 1158479, "filter_size": 0, "raw_key_size": 184730679, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39692, "num_entries": 6841877, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:15:59.654760 739fe390 (Original Log Time 2018/07/27-04:15:52.692426) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:15:59.654789 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 8] Flushing memtable with next log file: 2377
- 2018/07/27-04:15:59.654807 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 8] Flushing memtable with next log file: 2380
- 2018/07/27-04:15:59.654879 739fe390 EVENT_LOG_v1 {"time_micros": 1532664959654847, "job": 8, "event": "flush_started", "num_memtables": 2, "num_entries": 3515027, "num_deletes": 0, "memory_usage": 140724056, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:15:59.654894 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 8] Level-0 flush table #2381: started
- 2018/07/27-04:16:13.321290 739fe390 EVENT_LOG_v1 {"time_micros": 1532664973321196, "cf_name": "default", "job": 8, "event": "table_file_creation", "file_number": 2381, "file_size": 86955762, "table_properties": {"data_size": 86521833, "index_size": 637404, "filter_size": 0, "raw_key_size": 100023098, "raw_average_key_size": 28, "raw_value_size": 2397760, "raw_average_value_size": 0, "num_data_blocks": 23998, "num_entries": 3510402, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:16:13.359852 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 8] Level-0 flush table #2381: 86955762 bytes OK
- 2018/07/27-04:16:13.373250 739fe390 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44963148362
- 2018/07/27-04:16:13.373378 739fe390 (Original Log Time 2018/07/27-04:16:13.360573) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2381 started
- 2018/07/27-04:16:13.373388 739fe390 (Original Log Time 2018/07/27-04:16:13.373133) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2381: memtable #1 done
- 2018/07/27-04:16:13.373397 739fe390 (Original Log Time 2018/07/27-04:16:13.373147) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2381: memtable #2 done
- 2018/07/27-04:16:13.373405 739fe390 (Original Log Time 2018/07/27-04:16:13.373233) EVENT_LOG_v1 {"time_micros": 1532664973373183, "job": 8, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [7, 37, 120, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:16:13.373414 739fe390 (Original Log Time 2018/07/27-04:16:13.373327) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[7 37 120 23 0 0 0] max score 17.13
- 2018/07/27-04:16:13.373621 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 8] Try to delete WAL files size 84967780, prev total WAL file size 103117812, number of live WAL files 3.
- 2018/07/27-04:16:27.662310 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 6] Generated table #2382: 6069661 keys, 119556985 bytes
- 2018/07/27-04:16:27.663723 741ff390 EVENT_LOG_v1 {"time_micros": 1532664987663637, "cf_name": "default", "job": 6, "event": "table_file_creation", "file_number": 2382, "file_size": 119556985, "table_properties": {"data_size": 118855740, "index_size": 1026800, "filter_size": 0, "raw_key_size": 163880847, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 35188, "num_entries": 6069661, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:16:27.711820 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 6] Compacted 1@1 + 7@2 files to L2 => 1064633109 bytes
- 2018/07/27-04:16:27.716365 741ff390 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44782818390
- 2018/07/27-04:16:27.716597 741ff390 (Original Log Time 2018/07/27-04:16:27.716203) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[7 36 121 23 0 0 0] max score 17.13, MB/sec: 4.0 rd, 3.9 wr, level 2, files in(1, 7) out(8) MB in(128.7, 894.8) out(1015.3), read-write-amplify(15.8) write-amplify(7.9) OK, records in: 6352371, records dropped: 0 output_compression: Snappy
- 2018/07/27-04:16:27.716637 741ff390 (Original Log Time 2018/07/27-04:16:27.716343) EVENT_LOG_v1 {"time_micros": 1532664987716268, "job": 6, "event": "compaction_finished", "compaction_time_micros": 270089801, "output_level": 2, "num_output_files": 8, "total_output_size": 1064633109, "num_input_records": 54020219, "num_output_records": 54020219, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [7, 36, 121, 23, 0, 0, 0]}
- 2018/07/27-04:16:27.751975 741ff390 EVENT_LOG_v1 {"time_micros": 1532664987751939, "job": 6, "event": "table_file_deletion", "file_number": 2303}
- 2018/07/27-04:16:27.774144 741ff390 EVENT_LOG_v1 {"time_micros": 1532664987774103, "job": 6, "event": "table_file_deletion", "file_number": 2163}
- 2018/07/27-04:16:27.775327 741ff390 EVENT_LOG_v1 {"time_micros": 1532664987775286, "job": 6, "event": "table_file_deletion", "file_number": 2161}
- 2018/07/27-04:16:27.906896 741ff390 EVENT_LOG_v1 {"time_micros": 1532664987906869, "job": 6, "event": "table_file_deletion", "file_number": 2111}
- 2018/07/27-04:16:27.946041 741ff390 EVENT_LOG_v1 {"time_micros": 1532664987946010, "job": 6, "event": "table_file_deletion", "file_number": 2110}
- 2018/07/27-04:16:27.946785 741ff390 EVENT_LOG_v1 {"time_micros": 1532664987946756, "job": 6, "event": "table_file_deletion", "file_number": 2107}
- 2018/07/27-04:16:27.947454 741ff390 EVENT_LOG_v1 {"time_micros": 1532664987947427, "job": 6, "event": "table_file_deletion", "file_number": 2106}
- 2018/07/27-04:16:27.968213 741ff390 EVENT_LOG_v1 {"time_micros": 1532664987968185, "job": 6, "event": "table_file_deletion", "file_number": 2104}
- 2018/07/27-04:16:27.988976 741ff390 [WARN] [rocksdb/db/db_impl.cc:491] ------- DUMPING STATS -------
- 2018/07/27-04:16:27.989113 741ff390 [WARN] [rocksdb/db/db_impl.cc:492]
- ** DB Stats **
- Uptime(secs): 669.3 total, 669.2 interval
- Cumulative writes: 15 writes, 12M keys, 15 commit groups, 0.9 writes per commit group, ingest: 0.28 GB, 0.43 MB/s
- Cumulative WAL: 15 writes, 15 syncs, 0.94 writes per sync, written: 0.28 GB, 0.43 MB/s
- Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- Interval writes: 15 writes, 12M keys, 15 commit groups, 0.9 writes per commit group, ingest: 289.67 MB, 0.43 MB/s
- Interval WAL: 15 writes, 15 syncs, 0.94 writes per sync, written: 0.28 MB, 0.43 MB/s
- Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- ** Compaction Stats [default] **
- Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- ----------------------------------------------------------------------------------------------------------------------------------------------------------
- L0 7/0 441.23 MB 1.8 0.0 0.0 0.0 0.3 0.3 0.0 1.0 0.0 5.2 50 4 12.590 0 0
- L1 36/0 4.28 GB 17.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L2 121/0 14.56 GB 5.8 2.4 0.4 2.1 2.4 0.4 0.0 6.4 3.7 3.7 669 3 222.838 24M 0
- L3 23/0 2.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Sum 187/0 21.83 GB 0.0 2.4 0.4 2.1 2.7 0.6 0.0 10.5 3.5 3.8 719 7 102.696 24M 0
- Int 0/0 0.00 KB 0.0 2.4 0.4 2.1 2.7 0.6 0.0 10.5 3.5 3.8 719 6 119.811 24M 0
- Uptime(secs): 669.3 total, 669.2 interval
- Flush(GB): cumulative 0.254, interval 0.254
- AddFile(GB): cumulative 0.000, interval 0.000
- AddFile(Total Files): cumulative 0, interval 0
- AddFile(L0 Files): cumulative 0, interval 0
- AddFile(Keys): cumulative 0, interval 0
- Cumulative compaction: 2.67 GB write, 4.09 MB/s write, 2.44 GB read, 3.73 MB/s read, 718.9 seconds
- Interval compaction: 2.67 GB write, 4.09 MB/s write, 2.44 GB read, 3.74 MB/s read, 718.9 seconds
- Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- ** File Read Latency Histogram By Level [default] **
- ** Compaction Stats [default] **
- Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- ----------------------------------------------------------------------------------------------------------------------------------------------------------
- L0 7/0 441.23 MB 1.8 0.0 0.0 0.0 0.3 0.3 0.0 1.0 0.0 5.2 50 4 12.590 0 0
- L1 36/0 4.28 GB 17.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L2 121/0 14.56 GB 5.8 2.4 0.4 2.1 2.4 0.4 0.0 6.4 3.7 3.7 669 3 222.838 24M 0
- L3 23/0 2.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Sum 187/0 21.83 GB 0.0 2.4 0.4 2.1 2.7 0.6 0.0 10.5 3.5 3.8 719 7 102.696 24M 0
- Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Uptime(secs): 669.3 total, 0.0 interval
- Flush(GB): cumulative 0.254, interval 0.000
- AddFile(GB): cumulative 0.000, interval 0.000
- AddFile(Total Files): cumulative 0, interval 0
- AddFile(L0 Files): cumulative 0, interval 0
- AddFile(Keys): cumulative 0, interval 0
- Cumulative compaction: 2.67 GB write, 4.09 MB/s write, 2.44 GB read, 3.73 MB/s read, 718.9 seconds
- Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- ** File Read Latency Histogram By Level [default] **
- 2018/07/27-04:16:27.989461 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 9] Compacting 1@1 + 7@2 files to L2, score 17.13
- 2018/07/27-04:16:27.989508 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 8 Base level 1, inputs: [2302(128MB)], [2152(128MB) 2153(128MB) 2155(128MB) 2156(128MB) 2157(128MB) 2160(128MB) 2369(128MB)]
- 2018/07/27-04:16:27.999322 741ff390 EVENT_LOG_v1 {"time_micros": 1532664987989544, "job": 9, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2302], "files_L2": [2152, 2153, 2155, 2156, 2157, 2160, 2369], "score": 17.1256, "input_data_size": 1079953661}
- 2018/07/27-04:16:53.191136 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 9] Generated table #2383: 4663095 keys, 134900170 bytes
- 2018/07/27-04:16:53.191374 741ff390 EVENT_LOG_v1 {"time_micros": 1532665013191289, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 2383, "file_size": 134900170, "table_properties": {"data_size": 134220759, "index_size": 1033389, "filter_size": 0, "raw_key_size": 131766747, "raw_average_key_size": 28, "raw_value_size": 33504000, "raw_average_value_size": 7, "num_data_blocks": 37291, "num_entries": 4663095, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:17:04.860453 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2385. Immutable memtables: 0.
- 2018/07/27-04:17:04.860670 76f71d30 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44782818390
- 2018/07/27-04:17:27.287424 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 9] Generated table #2384: 6846756 keys, 135009300 bytes
- 2018/07/27-04:17:27.307540 741ff390 EVENT_LOG_v1 {"time_micros": 1532665047307455, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 2384, "file_size": 135009300, "table_properties": {"data_size": 134217780, "index_size": 1159110, "filter_size": 0, "raw_key_size": 184862412, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39713, "num_entries": 6846756, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:18:00.790065 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 9] Generated table #2386: 6853800 keys, 135009709 bytes
- 2018/07/27-04:18:00.816430 741ff390 EVENT_LOG_v1 {"time_micros": 1532665080816274, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 2386, "file_size": 135009709, "table_properties": {"data_size": 134219474, "index_size": 1159423, "filter_size": 0, "raw_key_size": 185052600, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39722, "num_entries": 6853800, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:18:16.138901 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2388. Immutable memtables: 1.
- 2018/07/27-04:18:16.159248 76f71d30 [rocksdb/db/column_family.cc:852] [default] Increasing compaction threads because of estimated pending compaction bytes 44782818390
- 2018/07/27-04:18:26.068185 739fe390 (Original Log Time 2018/07/27-04:18:16.159351) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:18:26.100117 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 10] Flushing memtable with next log file: 2385
- 2018/07/27-04:18:26.100159 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 10] Flushing memtable with next log file: 2388
- 2018/07/27-04:18:26.100298 739fe390 EVENT_LOG_v1 {"time_micros": 1532665106100248, "job": 10, "event": "flush_started", "num_memtables": 2, "num_entries": 3297960, "num_deletes": 0, "memory_usage": 131491908, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:18:26.100318 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 10] Level-0 flush table #2389: started
- 2018/07/27-04:18:35.718843 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 9] Generated table #2387: 6847570 keys, 135009813 bytes
- 2018/07/27-04:18:35.719361 741ff390 EVENT_LOG_v1 {"time_micros": 1532665115719192, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 2387, "file_size": 135009813, "table_properties": {"data_size": 134219191, "index_size": 1158291, "filter_size": 0, "raw_key_size": 184884390, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39711, "num_entries": 6847570, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:18:36.146704 739fe390 EVENT_LOG_v1 {"time_micros": 1532665116146495, "cf_name": "default", "job": 10, "event": "table_file_creation", "file_number": 2389, "file_size": 80967713, "table_properties": {"data_size": 80561496, "index_size": 595230, "filter_size": 0, "raw_key_size": 93556404, "raw_average_key_size": 28, "raw_value_size": 2141968, "raw_average_value_size": 0, "num_data_blocks": 22436, "num_entries": 3293194, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:18:36.146953 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 10] Level-0 flush table #2389: 80967713 bytes OK
- 2018/07/27-04:18:36.262409 739fe390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 8 level-0 files
- 2018/07/27-04:18:36.262693 739fe390 (Original Log Time 2018/07/27-04:18:36.150366) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2389 started
- 2018/07/27-04:18:36.262717 739fe390 (Original Log Time 2018/07/27-04:18:36.262191) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2389: memtable #1 done
- 2018/07/27-04:18:36.262739 739fe390 (Original Log Time 2018/07/27-04:18:36.262214) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2389: memtable #2 done
- 2018/07/27-04:18:36.262758 739fe390 (Original Log Time 2018/07/27-04:18:36.262374) EVENT_LOG_v1 {"time_micros": 1532665116262276, "job": 10, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [8, 36, 121, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:18:36.262778 739fe390 (Original Log Time 2018/07/27-04:18:36.262565) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[8 36 121 23 0 0 0] max score 16.62
- 2018/07/27-04:18:36.263263 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 10] Try to delete WAL files size 79334154, prev total WAL file size 103554992, number of live WAL files 3.
- 2018/07/27-04:19:10.256280 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 9] Generated table #2390: 6852790 keys, 135010839 bytes
- 2018/07/27-04:19:10.370390 741ff390 EVENT_LOG_v1 {"time_micros": 1532665150370293, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 2390, "file_size": 135010839, "table_properties": {"data_size": 134220075, "index_size": 1160073, "filter_size": 0, "raw_key_size": 185025330, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39719, "num_entries": 6852790, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:19:25.114318 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2392. Immutable memtables: 0.
- 2018/07/27-04:19:25.140407 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 8 level-0 files
- 2018/07/27-04:19:41.614339 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 9] Generated table #2391: 6838618 keys, 135009154 bytes
- 2018/07/27-04:19:41.709809 741ff390 EVENT_LOG_v1 {"time_micros": 1532665181709627, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 2391, "file_size": 135009154, "table_properties": {"data_size": 134218616, "index_size": 1157273, "filter_size": 0, "raw_key_size": 184642686, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39668, "num_entries": 6838618, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:20:13.680225 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 9] Generated table #2393: 6861419 keys, 135013139 bytes
- 2018/07/27-04:20:13.734734 741ff390 EVENT_LOG_v1 {"time_micros": 1532665213734613, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 2393, "file_size": 135013139, "table_properties": {"data_size": 134218631, "index_size": 1159289, "filter_size": 0, "raw_key_size": 185258313, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39744, "num_entries": 6861419, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:20:42.147140 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2395. Immutable memtables: 1.
- 2018/07/27-04:20:42.162151 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 8 level-0 files
- 2018/07/27-04:20:47.347304 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 9] Generated table #2394: 6440194 keys, 126704494 bytes
- 2018/07/27-04:20:47.347707 741ff390 EVENT_LOG_v1 {"time_micros": 1532665247347556, "cf_name": "default", "job": 9, "event": "table_file_creation", "file_number": 2394, "file_size": 126704494, "table_properties": {"data_size": 125959149, "index_size": 1088789, "filter_size": 0, "raw_key_size": 173885238, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37288, "num_entries": 6440194, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:20:47.422406 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 9] Compacted 1@1 + 7@2 files to L2 => 1071666618 bytes
- 2018/07/27-04:20:47.452466 741ff390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 8 level-0 files
- 2018/07/27-04:20:47.453500 741ff390 (Original Log Time 2018/07/27-04:20:47.452200) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[8 35 122 23 0 0 0] max score 16.62, MB/sec: 4.2 rd, 4.1 wr, level 2, files in(1, 7) out(8) MB in(128.7, 901.2) out(1022.0), read-write-amplify(15.9) write-amplify(7.9) OK, records in: 13169998, records dropped: 1 output_compression: Snappy
- 2018/07/27-04:20:47.453565 741ff390 (Original Log Time 2018/07/27-04:20:47.452438) EVENT_LOG_v1 {"time_micros": 1532665247452307, "job": 9, "event": "compaction_finished", "compaction_time_micros": 259422659, "output_level": 2, "num_output_files": 8, "total_output_size": 1071666618, "num_input_records": 52204243, "num_output_records": 52204242, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [8, 35, 122, 23, 0, 0, 0]}
- 2018/07/27-04:20:47.500977 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 12] Compacting 1@1 + 8@2 files to L2, score 16.62
- 2018/07/27-04:20:47.501075 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 10 Base level 1, inputs: [2304(128MB)], [2382(114MB) 2113(128MB) 2114(128MB) 2134(128MB) 2137(128MB) 2138(128MB) 2140(128MB) 2141(128MB)]
- 2018/07/27-04:20:47.568573 741ff390 EVENT_LOG_v1 {"time_micros": 1532665247501132, "job": 12, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2304], "files_L2": [2382, 2113, 2114, 2134, 2137, 2138, 2140, 2141], "score": 16.6228, "input_data_size": 1199609804}
- 2018/07/27-04:21:00.275418 739fe390 (Original Log Time 2018/07/27-04:20:42.174545) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:21:01.202670 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 11] Flushing memtable with next log file: 2392
- 2018/07/27-04:21:01.202727 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 11] Flushing memtable with next log file: 2395
- 2018/07/27-04:21:01.498232 739fe390 EVENT_LOG_v1 {"time_micros": 1532665261488449, "job": 11, "event": "flush_started", "num_memtables": 2, "num_entries": 3833371, "num_deletes": 0, "memory_usage": 152287696, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:21:01.500476 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 11] Level-0 flush table #2396: started
- 2018/07/27-04:21:19.149695 739fe390 EVENT_LOG_v1 {"time_micros": 1532665279149514, "cf_name": "default", "job": 11, "event": "table_file_creation", "file_number": 2396, "file_size": 95218401, "table_properties": {"data_size": 94747378, "index_size": 695108, "filter_size": 0, "raw_key_size": 109036974, "raw_average_key_size": 28, "raw_value_size": 2686144, "raw_average_value_size": 0, "num_data_blocks": 26210, "num_entries": 3814800, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:21:19.149920 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 11] Level-0 flush table #2396: 95218401 bytes OK
- 2018/07/27-04:21:19.249605 739fe390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 9 level-0 files
- 2018/07/27-04:21:19.249939 739fe390 (Original Log Time 2018/07/27-04:21:19.166937) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2396 started
- 2018/07/27-04:21:19.249963 739fe390 (Original Log Time 2018/07/27-04:21:19.249274) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2396: memtable #1 done
- 2018/07/27-04:21:19.249985 739fe390 (Original Log Time 2018/07/27-04:21:19.249298) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2396: memtable #2 done
- 2018/07/27-04:21:19.250004 739fe390 (Original Log Time 2018/07/27-04:21:19.249548) EVENT_LOG_v1 {"time_micros": 1532665279249481, "job": 11, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [9, 35, 122, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:21:19.250024 739fe390 (Original Log Time 2018/07/27-04:21:19.249768) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[9 35 122 23 0 0 0] max score 16.12
- 2018/07/27-04:21:19.272362 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 11] Try to delete WAL files size 93026970, prev total WAL file size 116638040, number of live WAL files 3.
- 2018/07/27-04:21:19.413828 739fe390 EVENT_LOG_v1 {"time_micros": 1532665279413774, "job": 11, "event": "table_file_deletion", "file_number": 2369}
- 2018/07/27-04:21:19.415755 739fe390 EVENT_LOG_v1 {"time_micros": 1532665279415690, "job": 11, "event": "table_file_deletion", "file_number": 2302}
- 2018/07/27-04:21:19.446157 739fe390 EVENT_LOG_v1 {"time_micros": 1532665279446099, "job": 11, "event": "table_file_deletion", "file_number": 2160}
- 2018/07/27-04:21:19.471271 739fe390 EVENT_LOG_v1 {"time_micros": 1532665279471220, "job": 11, "event": "table_file_deletion", "file_number": 2157}
- 2018/07/27-04:21:19.472735 739fe390 EVENT_LOG_v1 {"time_micros": 1532665279472663, "job": 11, "event": "table_file_deletion", "file_number": 2156}
- 2018/07/27-04:21:19.524429 739fe390 EVENT_LOG_v1 {"time_micros": 1532665279524353, "job": 11, "event": "table_file_deletion", "file_number": 2155}
- 2018/07/27-04:21:19.715798 739fe390 EVENT_LOG_v1 {"time_micros": 1532665279715747, "job": 11, "event": "table_file_deletion", "file_number": 2153}
- 2018/07/27-04:21:19.774600 739fe390 EVENT_LOG_v1 {"time_micros": 1532665279774546, "job": 11, "event": "table_file_deletion", "file_number": 2152}
- 2018/07/27-04:21:32.756438 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 12] Generated table #2397: 6850438 keys, 135009208 bytes
- 2018/07/27-04:21:32.756726 741ff390 EVENT_LOG_v1 {"time_micros": 1532665292756625, "cf_name": "default", "job": 12, "event": "table_file_creation", "file_number": 2397, "file_size": 135009208, "table_properties": {"data_size": 134218363, "index_size": 1159413, "filter_size": 0, "raw_key_size": 184961826, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39721, "num_entries": 6850438, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:21:59.889223 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2399. Immutable memtables: 0.
- 2018/07/27-04:22:00.039722 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 9 level-0 files
- 2018/07/27-04:22:07.313597 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 12] Generated table #2398: 6832970 keys, 135008936 bytes
- 2018/07/27-04:22:07.313832 741ff390 EVENT_LOG_v1 {"time_micros": 1532665327313747, "cf_name": "default", "job": 12, "event": "table_file_creation", "file_number": 2398, "file_size": 135008936, "table_properties": {"data_size": 134219429, "index_size": 1156013, "filter_size": 0, "raw_key_size": 184490190, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39651, "num_entries": 6832970, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:22:38.830538 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 12] Generated table #2400: 6845850 keys, 135011278 bytes
- 2018/07/27-04:22:38.950619 741ff390 EVENT_LOG_v1 {"time_micros": 1532665358950524, "cf_name": "default", "job": 12, "event": "table_file_creation", "file_number": 2400, "file_size": 135011278, "table_properties": {"data_size": 134220798, "index_size": 1157759, "filter_size": 0, "raw_key_size": 184837950, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39696, "num_entries": 6845850, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:23:11.109519 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 12] Generated table #2401: 6850471 keys, 135008939 bytes
- 2018/07/27-04:23:11.175336 741ff390 EVENT_LOG_v1 {"time_micros": 1532665391175209, "cf_name": "default", "job": 12, "event": "table_file_creation", "file_number": 2401, "file_size": 135008939, "table_properties": {"data_size": 134218011, "index_size": 1158960, "filter_size": 0, "raw_key_size": 184962717, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39713, "num_entries": 6850471, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:23:22.967432 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2403. Immutable memtables: 1.
- 2018/07/27-04:23:23.219331 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 9 level-0 files
- 2018/07/27-04:23:37.977310 739fe390 (Original Log Time 2018/07/27-04:23:23.420057) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:23:38.008723 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 13] Flushing memtable with next log file: 2399
- 2018/07/27-04:23:38.008755 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 13] Flushing memtable with next log file: 2403
- 2018/07/27-04:23:38.048944 739fe390 EVENT_LOG_v1 {"time_micros": 1532665418037548, "job": 13, "event": "flush_started", "num_memtables": 2, "num_entries": 3696060, "num_deletes": 0, "memory_usage": 145367380, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:23:38.055341 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 13] Level-0 flush table #2404: started
- 2018/07/27-04:23:52.267763 739fe390 EVENT_LOG_v1 {"time_micros": 1532665432267665, "cf_name": "default", "job": 13, "event": "table_file_creation", "file_number": 2404, "file_size": 90911010, "table_properties": {"data_size": 90455832, "index_size": 669154, "filter_size": 0, "raw_key_size": 105114982, "raw_average_key_size": 28, "raw_value_size": 2510772, "raw_average_value_size": 0, "num_data_blocks": 25163, "num_entries": 3688856, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:23:52.270469 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 12] Generated table #2402: 6856677 keys, 135011749 bytes
- 2018/07/27-04:23:52.305212 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 13] Level-0 flush table #2404: 90911010 bytes OK
- 2018/07/27-04:23:52.305605 741ff390 EVENT_LOG_v1 {"time_micros": 1532665432305507, "cf_name": "default", "job": 12, "event": "table_file_creation", "file_number": 2402, "file_size": 135011749, "table_properties": {"data_size": 134220664, "index_size": 1160026, "filter_size": 0, "raw_key_size": 185130279, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39742, "num_entries": 6856677, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:23:52.335653 739fe390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 10 level-0 files
- 2018/07/27-04:23:52.335810 739fe390 (Original Log Time 2018/07/27-04:23:52.318703) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2404 started
- 2018/07/27-04:23:52.335820 739fe390 (Original Log Time 2018/07/27-04:23:52.335531) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2404: memtable #1 done
- 2018/07/27-04:23:52.335829 739fe390 (Original Log Time 2018/07/27-04:23:52.335545) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2404: memtable #2 done
- 2018/07/27-04:23:52.335837 739fe390 (Original Log Time 2018/07/27-04:23:52.335623) EVENT_LOG_v1 {"time_micros": 1532665432335579, "job": 13, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [10, 35, 122, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:23:52.335846 739fe390 (Original Log Time 2018/07/27-04:23:52.335746) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[10 35 122 23 0 0 0] max score 16.12
- 2018/07/27-04:23:52.358472 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 13] Try to delete WAL files size 89331986, prev total WAL file size 115326122, number of live WAL files 3.
- 2018/07/27-04:24:26.623061 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 12] Generated table #2405: 6846437 keys, 135010438 bytes
- 2018/07/27-04:24:26.650554 741ff390 EVENT_LOG_v1 {"time_micros": 1532665466650449, "cf_name": "default", "job": 12, "event": "table_file_creation", "file_number": 2405, "file_size": 135010438, "table_properties": {"data_size": 134220430, "index_size": 1158347, "filter_size": 0, "raw_key_size": 184853799, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39701, "num_entries": 6846437, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:24:55.512412 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2407. Immutable memtables: 0.
- 2018/07/27-04:24:55.520963 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 10 level-0 files
- 2018/07/27-04:25:00.486907 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 12] Generated table #2406: 6847763 keys, 135009301 bytes
- 2018/07/27-04:25:00.487041 741ff390 EVENT_LOG_v1 {"time_micros": 1532665500486964, "cf_name": "default", "job": 12, "event": "table_file_creation", "file_number": 2406, "file_size": 135009301, "table_properties": {"data_size": 134218582, "index_size": 1158773, "filter_size": 0, "raw_key_size": 184889601, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39710, "num_entries": 6847763, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:25:32.346136 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 12] Generated table #2408: 6849944 keys, 135010795 bytes
- 2018/07/27-04:25:32.439533 741ff390 EVENT_LOG_v1 {"time_micros": 1532665532439443, "cf_name": "default", "job": 12, "event": "table_file_creation", "file_number": 2408, "file_size": 135010795, "table_properties": {"data_size": 134219978, "index_size": 1158630, "filter_size": 0, "raw_key_size": 184948488, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39722, "num_entries": 6849944, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:25:57.790830 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 12] Generated table #2409: 5633860 keys, 111003809 bytes
- 2018/07/27-04:25:57.800852 741ff390 EVENT_LOG_v1 {"time_micros": 1532665557800725, "cf_name": "default", "job": 12, "event": "table_file_creation", "file_number": 2409, "file_size": 111003809, "table_properties": {"data_size": 110352246, "index_size": 953124, "filter_size": 0, "raw_key_size": 152114220, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 32670, "num_entries": 5633860, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:25:57.826210 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 12] Compacted 1@1 + 8@2 files to L2 => 1191084453 bytes
- 2018/07/27-04:25:57.859165 741ff390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 10 level-0 files
- 2018/07/27-04:25:57.859683 741ff390 (Original Log Time 2018/07/27-04:25:57.858956) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[10 34 123 23 0 0 0] max score 16.12, MB/sec: 3.9 rd, 3.8 wr, level 2, files in(1, 8) out(9) MB in(128.7, 1015.3) out(1135.9), read-write-amplify(17.7) write-amplify(8.8) OK, records in: 12425785, records dropped: 0 output_compression: Snappy
- 2018/07/27-04:25:57.859779 741ff390 (Original Log Time 2018/07/27-04:25:57.859123) EVENT_LOG_v1 {"time_micros": 1532665557859036, "job": 12, "event": "compaction_finished", "compaction_time_micros": 310246409, "output_level": 2, "num_output_files": 9, "total_output_size": 1191084453, "num_input_records": 60414410, "num_output_records": 60414410, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [10, 34, 123, 23, 0, 0, 0]}
- 2018/07/27-04:25:58.100388 741ff390 EVENT_LOG_v1 {"time_micros": 1532665558100349, "job": 12, "event": "table_file_deletion", "file_number": 2382}
- 2018/07/27-04:25:58.187984 741ff390 EVENT_LOG_v1 {"time_micros": 1532665558187956, "job": 12, "event": "table_file_deletion", "file_number": 2304}
- 2018/07/27-04:25:58.287891 741ff390 EVENT_LOG_v1 {"time_micros": 1532665558287862, "job": 12, "event": "table_file_deletion", "file_number": 2141}
- 2018/07/27-04:25:58.298877 741ff390 EVENT_LOG_v1 {"time_micros": 1532665558298837, "job": 12, "event": "table_file_deletion", "file_number": 2140}
- 2018/07/27-04:25:58.333023 741ff390 EVENT_LOG_v1 {"time_micros": 1532665558332995, "job": 12, "event": "table_file_deletion", "file_number": 2138}
- 2018/07/27-04:25:58.382588 741ff390 EVENT_LOG_v1 {"time_micros": 1532665558382560, "job": 12, "event": "table_file_deletion", "file_number": 2137}
- 2018/07/27-04:25:58.390478 741ff390 EVENT_LOG_v1 {"time_micros": 1532665558390450, "job": 12, "event": "table_file_deletion", "file_number": 2134}
- 2018/07/27-04:25:58.437147 741ff390 EVENT_LOG_v1 {"time_micros": 1532665558437117, "job": 12, "event": "table_file_deletion", "file_number": 2114}
- 2018/07/27-04:25:58.438086 741ff390 EVENT_LOG_v1 {"time_micros": 1532665558438064, "job": 12, "event": "table_file_deletion", "file_number": 2113}
- 2018/07/27-04:25:58.451137 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 14] Compacting 1@1 + 8@2 files to L2, score 16.12
- 2018/07/27-04:25:58.451191 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 13 Base level 1, inputs: [2308(128MB)], [2365(128MB) 2368(83MB) 2118(128MB) 2120(128MB) 2121(128MB) 2124(128MB) 2126(128MB) 2127(128MB)]
- 2018/07/27-04:25:58.460711 741ff390 EVENT_LOG_v1 {"time_micros": 1532665558451223, "job": 14, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2308], "files_L2": [2365, 2368, 2118, 2120, 2121, 2124, 2126, 2127], "score": 16.12, "input_data_size": 1168023371}
- 2018/07/27-04:26:06.706379 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2411. Immutable memtables: 1.
- 2018/07/27-04:26:06.706530 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 10 level-0 files
- 2018/07/27-04:26:16.036696 739fe390 (Original Log Time 2018/07/27-04:26:06.706590) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:26:16.055179 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 15] Flushing memtable with next log file: 2407
- 2018/07/27-04:26:16.055223 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 15] Flushing memtable with next log file: 2411
- 2018/07/27-04:26:16.055367 739fe390 EVENT_LOG_v1 {"time_micros": 1532665576055312, "job": 15, "event": "flush_started", "num_memtables": 2, "num_entries": 4192983, "num_deletes": 0, "memory_usage": 164486840, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:26:16.055388 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 15] Level-0 flush table #2412: started
- 2018/07/27-04:26:34.130149 739fe390 EVENT_LOG_v1 {"time_micros": 1532665594130047, "cf_name": "default", "job": 15, "event": "table_file_creation", "file_number": 2412, "file_size": 104833549, "table_properties": {"data_size": 104316651, "index_size": 764394, "filter_size": 0, "raw_key_size": 119836414, "raw_average_key_size": 28, "raw_value_size": 2991140, "raw_average_value_size": 0, "num_data_blocks": 28801, "num_entries": 4187602, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:26:34.254106 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 15] Level-0 flush table #2412: 104833549 bytes OK
- 2018/07/27-04:26:34.277762 739fe390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 11 level-0 files
- 2018/07/27-04:26:34.277907 739fe390 (Original Log Time 2018/07/27-04:26:34.254959) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2412 started
- 2018/07/27-04:26:34.277917 739fe390 (Original Log Time 2018/07/27-04:26:34.277646) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2412: memtable #1 done
- 2018/07/27-04:26:34.277926 739fe390 (Original Log Time 2018/07/27-04:26:34.277659) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2412: memtable #2 done
- 2018/07/27-04:26:34.277934 739fe390 (Original Log Time 2018/07/27-04:26:34.277740) EVENT_LOG_v1 {"time_micros": 1532665594277690, "job": 15, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [11, 34, 123, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:26:34.277943 739fe390 (Original Log Time 2018/07/27-04:26:34.277845) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[11 34 123 23 0 0 0] max score 15.62
- 2018/07/27-04:26:34.278127 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 15] Try to delete WAL files size 102003596, prev total WAL file size 124373694, number of live WAL files 3.
- 2018/07/27-04:26:38.000428 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 14] Generated table #2410: 6845656 keys, 135010213 bytes
- 2018/07/27-04:26:38.000557 741ff390 EVENT_LOG_v1 {"time_micros": 1532665598000482, "cf_name": "default", "job": 14, "event": "table_file_creation", "file_number": 2410, "file_size": 135010213, "table_properties": {"data_size": 134218136, "index_size": 1159321, "filter_size": 0, "raw_key_size": 184832712, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39697, "num_entries": 6845656, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:27:13.464634 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 14] Generated table #2413: 6841414 keys, 135007965 bytes
- 2018/07/27-04:27:13.541620 741ff390 EVENT_LOG_v1 {"time_micros": 1532665633541524, "cf_name": "default", "job": 14, "event": "table_file_creation", "file_number": 2413, "file_size": 135007965, "table_properties": {"data_size": 134218687, "index_size": 1156958, "filter_size": 0, "raw_key_size": 184718178, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39676, "num_entries": 6841414, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:27:28.149836 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2415. Immutable memtables: 0.
- 2018/07/27-04:27:28.150166 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 11 level-0 files
- 2018/07/27-04:27:47.216008 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 14] Generated table #2414: 6841183 keys, 135007898 bytes
- 2018/07/27-04:27:47.271857 741ff390 EVENT_LOG_v1 {"time_micros": 1532665667271769, "cf_name": "default", "job": 14, "event": "table_file_creation", "file_number": 2414, "file_size": 135007898, "table_properties": {"data_size": 134218336, "index_size": 1157086, "filter_size": 0, "raw_key_size": 184711941, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39682, "num_entries": 6841183, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:28:21.052833 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 14] Generated table #2416: 6845143 keys, 135009534 bytes
- 2018/07/27-04:28:21.090711 741ff390 EVENT_LOG_v1 {"time_micros": 1532665701090607, "cf_name": "default", "job": 14, "event": "table_file_creation", "file_number": 2416, "file_size": 135009534, "table_properties": {"data_size": 134218484, "index_size": 1159113, "filter_size": 0, "raw_key_size": 184818861, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39697, "num_entries": 6845143, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:28:34.250290 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2418. Immutable memtables: 1.
- 2018/07/27-04:28:34.250545 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 11 level-0 files
- 2018/07/27-04:28:43.666963 739fe390 (Original Log Time 2018/07/27-04:28:34.265209) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:28:43.673738 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 16] Flushing memtable with next log file: 2415
- 2018/07/27-04:28:43.673872 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 16] Flushing memtable with next log file: 2418
- 2018/07/27-04:28:43.674205 739fe390 EVENT_LOG_v1 {"time_micros": 1532665723674100, "job": 16, "event": "flush_started", "num_memtables": 2, "num_entries": 3707878, "num_deletes": 0, "memory_usage": 147776344, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:28:43.684476 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 16] Level-0 flush table #2419: started
- 2018/07/27-04:29:01.174451 739fe390 EVENT_LOG_v1 {"time_micros": 1532665741174347, "cf_name": "default", "job": 16, "event": "table_file_creation", "file_number": 2419, "file_size": 92172082, "table_properties": {"data_size": 91714865, "index_size": 673618, "filter_size": 0, "raw_key_size": 105746485, "raw_average_key_size": 28, "raw_value_size": 2570900, "raw_average_value_size": 0, "num_data_blocks": 25384, "num_entries": 3704553, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:29:01.174599 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 16] Level-0 flush table #2419: 92172082 bytes OK
- 2018/07/27-04:29:01.343211 739fe390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 12 level-0 files
- 2018/07/27-04:29:01.351253 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 14] Generated table #2417: 6847734 keys, 135009471 bytes
- 2018/07/27-04:29:01.351378 741ff390 EVENT_LOG_v1 {"time_micros": 1532665741351306, "cf_name": "default", "job": 14, "event": "table_file_creation", "file_number": 2417, "file_size": 135009471, "table_properties": {"data_size": 134219052, "index_size": 1158664, "filter_size": 0, "raw_key_size": 184888818, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39707, "num_entries": 6847734, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:29:01.377930 739fe390 (Original Log Time 2018/07/27-04:29:01.175480) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2419 started
- 2018/07/27-04:29:01.401302 739fe390 (Original Log Time 2018/07/27-04:29:01.343088) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2419: memtable #1 done
- 2018/07/27-04:29:01.401323 739fe390 (Original Log Time 2018/07/27-04:29:01.343094) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2419: memtable #2 done
- 2018/07/27-04:29:01.401332 739fe390 (Original Log Time 2018/07/27-04:29:01.343190) EVENT_LOG_v1 {"time_micros": 1532665741343136, "job": 16, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [12, 34, 123, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:29:01.401341 739fe390 (Original Log Time 2018/07/27-04:29:01.343310) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[12 34 123 23 0 0 0] max score 15.62
- 2018/07/27-04:29:01.401543 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 16] Try to delete WAL files size 89867552, prev total WAL file size 109786150, number of live WAL files 3.
- 2018/07/27-04:29:33.777703 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 14] Generated table #2420: 6845699 keys, 135010281 bytes
- 2018/07/27-04:29:33.842582 741ff390 EVENT_LOG_v1 {"time_micros": 1532665773842490, "cf_name": "default", "job": 14, "event": "table_file_creation", "file_number": 2420, "file_size": 135010281, "table_properties": {"data_size": 134219544, "index_size": 1158892, "filter_size": 0, "raw_key_size": 184833873, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39693, "num_entries": 6845699, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:29:49.599891 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2422. Immutable memtables: 0.
- 2018/07/27-04:29:49.600032 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 12 level-0 files
- 2018/07/27-04:30:08.812055 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 14] Generated table #2421: 6839814 keys, 135011016 bytes
- 2018/07/27-04:30:08.846124 741ff390 EVENT_LOG_v1 {"time_micros": 1532665808846037, "cf_name": "default", "job": 14, "event": "table_file_creation", "file_number": 2421, "file_size": 135011016, "table_properties": {"data_size": 134221113, "index_size": 1156929, "filter_size": 0, "raw_key_size": 184674978, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39690, "num_entries": 6839814, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:30:41.497438 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 14] Generated table #2423: 6837812 keys, 135009323 bytes
- 2018/07/27-04:30:41.581724 741ff390 EVENT_LOG_v1 {"time_micros": 1532665841581631, "cf_name": "default", "job": 14, "event": "table_file_creation", "file_number": 2423, "file_size": 135009323, "table_properties": {"data_size": 134219732, "index_size": 1157302, "filter_size": 0, "raw_key_size": 184620924, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39668, "num_entries": 6837812, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:31:00.937699 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 14] Generated table #2424: 4023214 keys, 79292413 bytes
- 2018/07/27-04:31:01.054793 741ff390 EVENT_LOG_v1 {"time_micros": 1532665861054701, "cf_name": "default", "job": 14, "event": "table_file_creation", "file_number": 2424, "file_size": 79292413, "table_properties": {"data_size": 78827922, "index_size": 680428, "filter_size": 0, "raw_key_size": 108626778, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 23320, "num_entries": 4023214, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:31:01.079846 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 14] Compacted 1@1 + 8@2 files to L2 => 1159368114 bytes
- 2018/07/27-04:31:01.144762 741ff390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 12 level-0 files
- 2018/07/27-04:31:01.146691 741ff390 (Original Log Time 2018/07/27-04:31:01.122613) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[12 33 124 23 0 0 0] max score 15.62, MB/sec: 3.9 rd, 3.8 wr, level 2, files in(1, 8) out(9) MB in(128.7, 985.2) out(1105.7), read-write-amplify(17.2) write-amplify(8.6) OK, records in: 17647266, records dropped: 0 output_compression: Snappy
- 2018/07/27-04:31:01.146783 741ff390 (Original Log Time 2018/07/27-04:31:01.122739) EVENT_LOG_v1 {"time_micros": 1532665861122671, "job": 14, "event": "compaction_finished", "compaction_time_micros": 302601427, "output_level": 2, "num_output_files": 9, "total_output_size": 1159368114, "num_input_records": 58767669, "num_output_records": 58767669, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [12, 33, 124, 23, 0, 0, 0]}
- 2018/07/27-04:31:01.243524 741ff390 EVENT_LOG_v1 {"time_micros": 1532665861243497, "job": 14, "event": "table_file_deletion", "file_number": 2368}
- 2018/07/27-04:31:01.353165 741ff390 EVENT_LOG_v1 {"time_micros": 1532665861353136, "job": 14, "event": "table_file_deletion", "file_number": 2365}
- 2018/07/27-04:31:01.375813 741ff390 EVENT_LOG_v1 {"time_micros": 1532665861375777, "job": 14, "event": "table_file_deletion", "file_number": 2308}
- 2018/07/27-04:31:01.492067 741ff390 EVENT_LOG_v1 {"time_micros": 1532665861492039, "job": 14, "event": "table_file_deletion", "file_number": 2127}
- 2018/07/27-04:31:01.514104 741ff390 EVENT_LOG_v1 {"time_micros": 1532665861514063, "job": 14, "event": "table_file_deletion", "file_number": 2126}
- 2018/07/27-04:31:01.517524 741ff390 EVENT_LOG_v1 {"time_micros": 1532665861517498, "job": 14, "event": "table_file_deletion", "file_number": 2124}
- 2018/07/27-04:31:01.561515 741ff390 EVENT_LOG_v1 {"time_micros": 1532665861561488, "job": 14, "event": "table_file_deletion", "file_number": 2121}
- 2018/07/27-04:31:01.562105 741ff390 EVENT_LOG_v1 {"time_micros": 1532665861562084, "job": 14, "event": "table_file_deletion", "file_number": 2120}
- 2018/07/27-04:31:01.562606 741ff390 EVENT_LOG_v1 {"time_micros": 1532665861562587, "job": 14, "event": "table_file_deletion", "file_number": 2118}
- 2018/07/27-04:31:01.657732 741ff390 [WARN] [rocksdb/db/db_impl.cc:491] ------- DUMPING STATS -------
- 2018/07/27-04:31:01.657853 741ff390 [WARN] [rocksdb/db/db_impl.cc:492]
- ** DB Stats **
- Uptime(secs): 1543.0 total, 873.7 interval
- Cumulative writes: 37 writes, 33M keys, 37 commit groups, 1.0 writes per commit group, ingest: 0.75 GB, 0.50 MB/s
- Cumulative WAL: 37 writes, 37 syncs, 0.97 writes per sync, written: 0.75 GB, 0.50 MB/s
- Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- Interval writes: 22 writes, 20M keys, 22 commit groups, 1.0 writes per commit group, ingest: 480.77 MB, 0.55 MB/s
- Interval WAL: 22 writes, 22 syncs, 0.96 writes per sync, written: 0.47 MB, 0.55 MB/s
- Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- ** Compaction Stats [default] **
- Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- ----------------------------------------------------------------------------------------------------------------------------------------------------------
- L0 12/0 883.84 MB 3.5 0.0 0.0 0.0 0.7 0.7 0.0 1.0 0.0 5.4 129 9 14.378 0 0
- L1 33/0 3.90 GB 15.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L2 124/0 14.92 GB 6.0 5.7 0.8 4.9 5.6 0.7 0.0 7.4 3.8 3.7 1541 6 256.797 67M 1
- L3 23/0 2.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Sum 192/0 22.23 GB 0.0 5.7 0.8 4.9 6.3 1.4 0.0 9.2 3.5 3.9 1670 15 111.346 67M 1
- Int 0/0 0.00 KB 0.0 3.2 0.4 2.8 3.6 0.8 0.0 8.4 3.5 3.9 951 8 118.914 43M 1
- Uptime(secs): 1543.0 total, 873.7 interval
- Flush(GB): cumulative 0.687, interval 0.432
- AddFile(GB): cumulative 0.000, interval 0.000
- AddFile(Total Files): cumulative 0, interval 0
- AddFile(L0 Files): cumulative 0, interval 0
- AddFile(Keys): cumulative 0, interval 0
- Cumulative compaction: 6.29 GB write, 4.18 MB/s write, 5.65 GB read, 3.75 MB/s read, 1670.2 seconds
- Interval compaction: 3.62 GB write, 4.24 MB/s write, 3.21 GB read, 3.76 MB/s read, 951.3 seconds
- Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- ** File Read Latency Histogram By Level [default] **
- ** Compaction Stats [default] **
- Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- ----------------------------------------------------------------------------------------------------------------------------------------------------------
- L0 12/0 883.84 MB 3.5 0.0 0.0 0.0 0.7 0.7 0.0 1.0 0.0 5.4 129 9 14.378 0 0
- L1 33/0 3.90 GB 15.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L2 124/0 14.92 GB 6.0 5.7 0.8 4.9 5.6 0.7 0.0 7.4 3.8 3.7 1541 6 256.797 67M 1
- L3 23/0 2.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Sum 192/0 22.23 GB 0.0 5.7 0.8 4.9 6.3 1.4 0.0 9.2 3.5 3.9 1670 15 111.346 67M 1
- Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Uptime(secs): 1543.0 total, 0.0 interval
- Flush(GB): cumulative 0.687, interval 0.000
- AddFile(GB): cumulative 0.000, interval 0.000
- AddFile(Total Files): cumulative 0, interval 0
- AddFile(L0 Files): cumulative 0, interval 0
- AddFile(Keys): cumulative 0, interval 0
- Cumulative compaction: 6.29 GB write, 4.18 MB/s write, 5.65 GB read, 3.75 MB/s read, 1670.2 seconds
- Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- ** File Read Latency Histogram By Level [default] **
- 2018/07/27-04:31:01.658205 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 17] Compacting 1@1 + 8@2 files to L2, score 15.62
- 2018/07/27-04:31:01.658247 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 16 Base level 1, inputs: [2310(128MB)], [2424(75MB) 2130(128MB) 2131(128MB) 2166(128MB) 2167(128MB) 2168(128MB) 2170(128MB) 2171(128MB)]
- 2018/07/27-04:31:01.664132 741ff390 EVENT_LOG_v1 {"time_micros": 1532665861658281, "job": 17, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2310], "files_L2": [2424, 2130, 2131, 2166, 2167, 2168, 2170, 2171], "score": 15.6172, "input_data_size": 1159188577}
- 2018/07/27-04:31:09.522962 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2426. Immutable memtables: 1.
- 2018/07/27-04:31:09.523049 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 12 level-0 files
- 2018/07/27-04:31:19.656752 739fe390 (Original Log Time 2018/07/27-04:31:09.523164) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:31:19.664111 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 18] Flushing memtable with next log file: 2422
- 2018/07/27-04:31:19.664149 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 18] Flushing memtable with next log file: 2426
- 2018/07/27-04:31:19.664286 739fe390 EVENT_LOG_v1 {"time_micros": 1532665879664236, "job": 18, "event": "flush_started", "num_memtables": 2, "num_entries": 3615802, "num_deletes": 0, "memory_usage": 146523068, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:31:19.664302 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 18] Level-0 flush table #2427: started
- 2018/07/27-04:31:32.807548 739fe390 EVENT_LOG_v1 {"time_micros": 1532665892807447, "cf_name": "default", "job": 18, "event": "table_file_creation", "file_number": 2427, "file_size": 89145781, "table_properties": {"data_size": 88699630, "index_size": 654758, "filter_size": 0, "raw_key_size": 102783078, "raw_average_key_size": 28, "raw_value_size": 2378376, "raw_average_value_size": 0, "num_data_blocks": 24694, "num_entries": 3612276, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:31:32.807690 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 18] Level-0 flush table #2427: 89145781 bytes OK
- 2018/07/27-04:31:32.953750 739fe390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 13 level-0 files
- 2018/07/27-04:31:32.953891 739fe390 (Original Log Time 2018/07/27-04:31:32.808492) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2427 started
- 2018/07/27-04:31:32.953901 739fe390 (Original Log Time 2018/07/27-04:31:32.953629) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2427: memtable #1 done
- 2018/07/27-04:31:32.953910 739fe390 (Original Log Time 2018/07/27-04:31:32.953639) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2427: memtable #2 done
- 2018/07/27-04:31:32.953918 739fe390 (Original Log Time 2018/07/27-04:31:32.953730) EVENT_LOG_v1 {"time_micros": 1532665892953678, "job": 18, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [13, 33, 124, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:31:32.953927 739fe390 (Original Log Time 2018/07/27-04:31:32.953826) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[13 33 124 23 0 0 0] max score 15.11
- 2018/07/27-04:31:32.954199 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 18] Try to delete WAL files size 87177026, prev total WAL file size 108588650, number of live WAL files 3.
- 2018/07/27-04:31:36.456295 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 17] Generated table #2425: 6843555 keys, 135011220 bytes
- 2018/07/27-04:31:36.456423 741ff390 EVENT_LOG_v1 {"time_micros": 1532665896456348, "cf_name": "default", "job": 17, "event": "table_file_creation", "file_number": 2425, "file_size": 135011220, "table_properties": {"data_size": 134221086, "index_size": 1158236, "filter_size": 0, "raw_key_size": 184775985, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39677, "num_entries": 6843555, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:32:07.063892 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 17] Generated table #2428: 6847275 keys, 135011980 bytes
- 2018/07/27-04:32:07.090057 741ff390 EVENT_LOG_v1 {"time_micros": 1532665927089972, "cf_name": "default", "job": 17, "event": "table_file_creation", "file_number": 2428, "file_size": 135011980, "table_properties": {"data_size": 134220663, "index_size": 1159351, "filter_size": 0, "raw_key_size": 184876425, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39709, "num_entries": 6847275, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:32:18.465255 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2430. Immutable memtables: 0.
- 2018/07/27-04:32:18.465451 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 13 level-0 files
- 2018/07/27-04:32:38.973911 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 17] Generated table #2429: 6841723 keys, 135010761 bytes
- 2018/07/27-04:32:38.995011 741ff390 EVENT_LOG_v1 {"time_micros": 1532665958994920, "cf_name": "default", "job": 17, "event": "table_file_creation", "file_number": 2429, "file_size": 135010761, "table_properties": {"data_size": 134220686, "index_size": 1156995, "filter_size": 0, "raw_key_size": 184726521, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39694, "num_entries": 6841723, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:33:11.816922 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 17] Generated table #2431: 6846795 keys, 135012431 bytes
- 2018/07/27-04:33:11.817194 741ff390 EVENT_LOG_v1 {"time_micros": 1532665991817108, "cf_name": "default", "job": 17, "event": "table_file_creation", "file_number": 2431, "file_size": 135012431, "table_properties": {"data_size": 134221028, "index_size": 1159355, "filter_size": 0, "raw_key_size": 184863465, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39710, "num_entries": 6846795, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:33:16.563702 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2433. Immutable memtables: 1.
- 2018/07/27-04:33:16.563791 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 13 level-0 files
- 2018/07/27-04:33:24.442296 739fe390 (Original Log Time 2018/07/27-04:33:16.563918) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:33:24.449972 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 19] Flushing memtable with next log file: 2430
- 2018/07/27-04:33:24.450009 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 19] Flushing memtable with next log file: 2433
- 2018/07/27-04:33:24.450105 739fe390 EVENT_LOG_v1 {"time_micros": 1532666004450067, "job": 19, "event": "flush_started", "num_memtables": 2, "num_entries": 3396575, "num_deletes": 0, "memory_usage": 133468624, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:33:24.450125 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 19] Level-0 flush table #2434: started
- 2018/07/27-04:33:35.258403 739fe390 EVENT_LOG_v1 {"time_micros": 1532666015258303, "cf_name": "default", "job": 19, "event": "table_file_creation", "file_number": 2434, "file_size": 83838788, "table_properties": {"data_size": 83418211, "index_size": 616817, "filter_size": 0, "raw_key_size": 96828406, "raw_average_key_size": 28, "raw_value_size": 2335600, "raw_average_value_size": 0, "num_data_blocks": 23246, "num_entries": 3391244, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:33:35.258570 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 19] Level-0 flush table #2434: 83838788 bytes OK
- 2018/07/27-04:33:35.462202 739fe390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 14 level-0 files
- 2018/07/27-04:33:35.462353 739fe390 (Original Log Time 2018/07/27-04:33:35.425662) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2434 started
- 2018/07/27-04:33:35.462363 739fe390 (Original Log Time 2018/07/27-04:33:35.462084) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2434: memtable #1 done
- 2018/07/27-04:33:35.462372 739fe390 (Original Log Time 2018/07/27-04:33:35.462098) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2434: memtable #2 done
- 2018/07/27-04:33:35.462381 739fe390 (Original Log Time 2018/07/27-04:33:35.462184) EVENT_LOG_v1 {"time_micros": 1532666015462136, "job": 19, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [14, 33, 124, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:33:35.462390 739fe390 (Original Log Time 2018/07/27-04:33:35.462293) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[14 33 124 23 0 0 0] max score 15.11
- 2018/07/27-04:33:35.462605 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 19] Try to delete WAL files size 82320838, prev total WAL file size 102836142, number of live WAL files 3.
- 2018/07/27-04:33:47.767196 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 17] Generated table #2432: 6846287 keys, 135011283 bytes
- 2018/07/27-04:33:47.767446 741ff390 EVENT_LOG_v1 {"time_micros": 1532666027767359, "cf_name": "default", "job": 17, "event": "table_file_creation", "file_number": 2432, "file_size": 135011283, "table_properties": {"data_size": 134220650, "index_size": 1158783, "filter_size": 0, "raw_key_size": 184849749, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39700, "num_entries": 6846287, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:34:21.549405 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 17] Generated table #2435: 6843302 keys, 135009199 bytes
- 2018/07/27-04:34:21.628671 741ff390 EVENT_LOG_v1 {"time_micros": 1532666061628559, "cf_name": "default", "job": 17, "event": "table_file_creation", "file_number": 2435, "file_size": 135009199, "table_properties": {"data_size": 134218815, "index_size": 1157526, "filter_size": 0, "raw_key_size": 184769154, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39690, "num_entries": 6843302, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:34:46.318275 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2437. Immutable memtables: 0.
- 2018/07/27-04:34:46.318373 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 14 level-0 files
- 2018/07/27-04:34:54.125861 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 17] Generated table #2436: 7115218 keys, 134951748 bytes
- 2018/07/27-04:34:54.126088 741ff390 EVENT_LOG_v1 {"time_micros": 1532666094126011, "cf_name": "default", "job": 17, "event": "table_file_creation", "file_number": 2436, "file_size": 134951748, "table_properties": {"data_size": 134220993, "index_size": 1092243, "filter_size": 0, "raw_key_size": 178295526, "raw_average_key_size": 25, "raw_value_size": 32, "raw_average_value_size": 0, "num_data_blocks": 37895, "num_entries": 7115218, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:35:28.539493 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 17] Generated table #2438: 7209845 keys, 134945347 bytes
- 2018/07/27-04:35:28.714657 741ff390 EVENT_LOG_v1 {"time_micros": 1532666128714570, "cf_name": "default", "job": 17, "event": "table_file_creation", "file_number": 2438, "file_size": 134945347, "table_properties": {"data_size": 134218461, "index_size": 1100967, "filter_size": 0, "raw_key_size": 180246125, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37957, "num_entries": 7209845, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:35:43.820375 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 17] Generated table #2439: 3684803 keys, 69616186 bytes
- 2018/07/27-04:35:43.858831 741ff390 EVENT_LOG_v1 {"time_micros": 1532666143858727, "cf_name": "default", "job": 17, "event": "table_file_creation", "file_number": 2439, "file_size": 69616186, "table_properties": {"data_size": 69241223, "index_size": 563184, "filter_size": 0, "raw_key_size": 92120075, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 19509, "num_entries": 3684803, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:35:43.882517 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 17] Compacted 1@1 + 8@2 files to L2 => 1149580155 bytes
- 2018/07/27-04:35:43.915434 741ff390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 14 level-0 files
- 2018/07/27-04:35:43.916699 741ff390 (Original Log Time 2018/07/27-04:35:43.915287) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[14 32 125 23 0 0 0] max score 15.11, MB/sec: 4.1 rd, 4.1 wr, level 2, files in(1, 8) out(9) MB in(128.7, 976.8) out(1096.3), read-write-amplify(17.1) write-amplify(8.5) OK, records in: 10483491, records dropped: 1 output_compression: Snappy
- 2018/07/27-04:35:43.916734 741ff390 (Original Log Time 2018/07/27-04:35:43.915412) EVENT_LOG_v1 {"time_micros": 1532666143915347, "job": 17, "event": "compaction_finished", "compaction_time_micros": 282209561, "output_level": 2, "num_output_files": 9, "total_output_size": 1149580155, "num_input_records": 59078804, "num_output_records": 59078803, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [14, 32, 125, 23, 0, 0, 0]}
- 2018/07/27-04:35:43.930463 741ff390 EVENT_LOG_v1 {"time_micros": 1532666143930436, "job": 17, "event": "table_file_deletion", "file_number": 2424}
- 2018/07/27-04:35:43.958078 741ff390 EVENT_LOG_v1 {"time_micros": 1532666143958052, "job": 17, "event": "table_file_deletion", "file_number": 2310}
- 2018/07/27-04:35:44.068694 741ff390 EVENT_LOG_v1 {"time_micros": 1532666144068666, "job": 17, "event": "table_file_deletion", "file_number": 2171}
- 2018/07/27-04:35:44.069285 741ff390 EVENT_LOG_v1 {"time_micros": 1532666144069268, "job": 17, "event": "table_file_deletion", "file_number": 2170}
- 2018/07/27-04:35:44.069744 741ff390 EVENT_LOG_v1 {"time_micros": 1532666144069729, "job": 17, "event": "table_file_deletion", "file_number": 2168}
- 2018/07/27-04:35:44.070205 741ff390 EVENT_LOG_v1 {"time_micros": 1532666144070190, "job": 17, "event": "table_file_deletion", "file_number": 2167}
- 2018/07/27-04:35:44.102676 741ff390 EVENT_LOG_v1 {"time_micros": 1532666144102649, "job": 17, "event": "table_file_deletion", "file_number": 2166}
- 2018/07/27-04:35:44.134971 741ff390 EVENT_LOG_v1 {"time_micros": 1532666144134945, "job": 17, "event": "table_file_deletion", "file_number": 2131}
- 2018/07/27-04:35:44.135542 741ff390 EVENT_LOG_v1 {"time_micros": 1532666144135526, "job": 17, "event": "table_file_deletion", "file_number": 2130}
- 2018/07/27-04:35:44.160400 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 20] Compacting 1@1 + 7@2 files to L2, score 15.11
- 2018/07/27-04:35:44.160469 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 19 Base level 1, inputs: [2319(128MB)], [2235(41MB) 2184(128MB) 2185(128MB) 2186(128MB) 2189(128MB) 2190(128MB) 2192(128MB)]
- 2018/07/27-04:35:44.182969 741ff390 EVENT_LOG_v1 {"time_micros": 1532666144160501, "job": 20, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2319], "files_L2": [2235, 2184, 2185, 2186, 2189, 2190, 2192], "score": 15.1145, "input_data_size": 987974943}
- 2018/07/27-04:35:55.605704 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2441. Immutable memtables: 1.
- 2018/07/27-04:35:55.605807 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 14 level-0 files
- 2018/07/27-04:36:05.206433 739fe390 (Original Log Time 2018/07/27-04:35:55.605878) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:36:05.213376 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 21] Flushing memtable with next log file: 2437
- 2018/07/27-04:36:05.213419 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 21] Flushing memtable with next log file: 2441
- 2018/07/27-04:36:05.213540 739fe390 EVENT_LOG_v1 {"time_micros": 1532666165213488, "job": 21, "event": "flush_started", "num_memtables": 2, "num_entries": 4092360, "num_deletes": 0, "memory_usage": 164236368, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:36:05.213560 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 21] Level-0 flush table #2442: started
- 2018/07/27-04:36:20.164249 739fe390 EVENT_LOG_v1 {"time_micros": 1532666180164142, "cf_name": "default", "job": 21, "event": "table_file_creation", "file_number": 2442, "file_size": 100688864, "table_properties": {"data_size": 100188090, "index_size": 739060, "filter_size": 0, "raw_key_size": 116014868, "raw_average_key_size": 28, "raw_value_size": 2795612, "raw_average_value_size": 0, "num_data_blocks": 27801, "num_entries": 4069184, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:36:20.180352 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 21] Level-0 flush table #2442: 100688864 bytes OK
- 2018/07/27-04:36:20.203724 739fe390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 15 level-0 files
- 2018/07/27-04:36:20.203872 739fe390 (Original Log Time 2018/07/27-04:36:20.181051) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2442 started
- 2018/07/27-04:36:20.203882 739fe390 (Original Log Time 2018/07/27-04:36:20.203612) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2442: memtable #1 done
- 2018/07/27-04:36:20.203891 739fe390 (Original Log Time 2018/07/27-04:36:20.203626) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2442: memtable #2 done
- 2018/07/27-04:36:20.203899 739fe390 (Original Log Time 2018/07/27-04:36:20.203702) EVENT_LOG_v1 {"time_micros": 1532666180203661, "job": 21, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [15, 32, 125, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:36:20.203908 739fe390 (Original Log Time 2018/07/27-04:36:20.203807) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[15 32 125 23 0 0 0] max score 14.61
- 2018/07/27-04:36:20.204166 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 21] Try to delete WAL files size 98936124, prev total WAL file size 118959922, number of live WAL files 3.
- 2018/07/27-04:36:21.142640 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 20] Generated table #2440: 7119973 keys, 134940440 bytes
- 2018/07/27-04:36:21.142769 741ff390 EVENT_LOG_v1 {"time_micros": 1532666181142696, "cf_name": "default", "job": 20, "event": "table_file_creation", "file_number": 2440, "file_size": 134940440, "table_properties": {"data_size": 134218619, "index_size": 1087724, "filter_size": 0, "raw_key_size": 177999325, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37674, "num_entries": 7119973, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:36:59.113736 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 20] Generated table #2443: 7111250 keys, 134944300 bytes
- 2018/07/27-04:36:59.147825 741ff390 EVENT_LOG_v1 {"time_micros": 1532666219147736, "cf_name": "default", "job": 20, "event": "table_file_creation", "file_number": 2443, "file_size": 134944300, "table_properties": {"data_size": 134220858, "index_size": 1086756, "filter_size": 0, "raw_key_size": 177781250, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37681, "num_entries": 7111250, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:37:18.688812 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2445. Immutable memtables: 0.
- 2018/07/27-04:37:18.688904 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 15 level-0 files
- 2018/07/27-04:37:31.646787 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 20] Generated table #2444: 7083348 keys, 134942896 bytes
- 2018/07/27-04:37:31.672506 741ff390 EVENT_LOG_v1 {"time_micros": 1532666251672371, "cf_name": "default", "job": 20, "event": "table_file_creation", "file_number": 2444, "file_size": 134942896, "table_properties": {"data_size": 134220579, "index_size": 1083416, "filter_size": 0, "raw_key_size": 177083700, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37637, "num_entries": 7083348, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:38:03.906389 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 20] Generated table #2446: 7114353 keys, 134942592 bytes
- 2018/07/27-04:38:03.931001 741ff390 EVENT_LOG_v1 {"time_micros": 1532666283930909, "cf_name": "default", "job": 20, "event": "table_file_creation", "file_number": 2446, "file_size": 134942592, "table_properties": {"data_size": 134221079, "index_size": 1087140, "filter_size": 0, "raw_key_size": 177858825, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37671, "num_entries": 7114353, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:38:32.209609 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2448. Immutable memtables: 1.
- 2018/07/27-04:38:32.237551 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 15 level-0 files
- 2018/07/27-04:38:36.521772 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 20] Generated table #2447: 7123231 keys, 134941471 bytes
- 2018/07/27-04:38:36.521964 741ff390 EVENT_LOG_v1 {"time_micros": 1532666316521869, "cf_name": "default", "job": 20, "event": "table_file_creation", "file_number": 2447, "file_size": 134941471, "table_properties": {"data_size": 134219128, "index_size": 1088344, "filter_size": 0, "raw_key_size": 178080775, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37687, "num_entries": 7123231, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:38:40.709864 739fe390 (Original Log Time 2018/07/27-04:38:32.249719) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:38:40.709896 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 22] Flushing memtable with next log file: 2445
- 2018/07/27-04:38:40.709913 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 22] Flushing memtable with next log file: 2448
- 2018/07/27-04:38:40.710005 739fe390 EVENT_LOG_v1 {"time_micros": 1532666320709964, "job": 22, "event": "flush_started", "num_memtables": 2, "num_entries": 3851844, "num_deletes": 0, "memory_usage": 153435400, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:38:40.710027 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 22] Level-0 flush table #2449: started
- 2018/07/27-04:38:54.896873 739fe390 EVENT_LOG_v1 {"time_micros": 1532666334896763, "cf_name": "default", "job": 22, "event": "table_file_creation", "file_number": 2449, "file_size": 96080698, "table_properties": {"data_size": 95605204, "index_size": 701616, "filter_size": 0, "raw_key_size": 110066527, "raw_average_key_size": 28, "raw_value_size": 2735672, "raw_average_value_size": 0, "num_data_blocks": 26478, "num_entries": 3847285, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:38:54.909266 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 22] Level-0 flush table #2449: 96080698 bytes OK
- 2018/07/27-04:38:54.932660 739fe390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 16 level-0 files
- 2018/07/27-04:38:54.932823 739fe390 (Original Log Time 2018/07/27-04:38:54.909996) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2449 started
- 2018/07/27-04:38:54.932834 739fe390 (Original Log Time 2018/07/27-04:38:54.932532) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2449: memtable #1 done
- 2018/07/27-04:38:54.932843 739fe390 (Original Log Time 2018/07/27-04:38:54.932546) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2449: memtable #2 done
- 2018/07/27-04:38:54.932851 739fe390 (Original Log Time 2018/07/27-04:38:54.932634) EVENT_LOG_v1 {"time_micros": 1532666334932582, "job": 22, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [16, 32, 125, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:38:54.932860 739fe390 (Original Log Time 2018/07/27-04:38:54.932758) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[16 32 125 23 0 0 0] max score 14.61
- 2018/07/27-04:38:54.933078 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 22] Try to delete WAL files size 93663386, prev total WAL file size 115716380, number of live WAL files 3.
- 2018/07/27-04:39:11.276315 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 20] Generated table #2450: 7103350 keys, 134941533 bytes
- 2018/07/27-04:39:11.276582 741ff390 EVENT_LOG_v1 {"time_micros": 1532666351276498, "cf_name": "default", "job": 20, "event": "table_file_creation", "file_number": 2450, "file_size": 134941533, "table_properties": {"data_size": 134219876, "index_size": 1085644, "filter_size": 0, "raw_key_size": 177583750, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37640, "num_entries": 7103350, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:39:47.445383 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 20] Generated table #2451: 7182293 keys, 134941439 bytes
- 2018/07/27-04:39:47.445653 741ff390 EVENT_LOG_v1 {"time_micros": 1532666387445567, "cf_name": "default", "job": 20, "event": "table_file_creation", "file_number": 2451, "file_size": 134941439, "table_properties": {"data_size": 134217878, "index_size": 1096089, "filter_size": 0, "raw_key_size": 179557325, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37837, "num_entries": 7182293, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:39:54.395639 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 20] Generated table #2452: 1771692 keys, 30975618 bytes
- 2018/07/27-04:39:54.395833 741ff390 EVENT_LOG_v1 {"time_micros": 1532666394395775, "cf_name": "default", "job": 20, "event": "table_file_creation", "file_number": 2452, "file_size": 30975618, "table_properties": {"data_size": 30809847, "index_size": 266670, "filter_size": 0, "raw_key_size": 44292300, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 8890, "num_entries": 1771692, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:39:54.448690 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 20] Compacted 1@1 + 7@2 files to L2 => 975570289 bytes
- 2018/07/27-04:39:54.475596 741ff390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 16 level-0 files
- 2018/07/27-04:39:54.475764 741ff390 (Original Log Time 2018/07/27-04:39:54.475467) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[16 31 126 23 0 0 0] max score 14.61, MB/sec: 3.9 rd, 3.9 wr, level 2, files in(1, 7) out(8) MB in(128.7, 813.5) out(930.4), read-write-amplify(14.6) write-amplify(7.2) OK, records in: 6737520, records dropped: 0 output_compression: Snappy
- 2018/07/27-04:39:54.475791 741ff390 (Original Log Time 2018/07/27-04:39:54.475581) EVENT_LOG_v1 {"time_micros": 1532666394475518, "job": 20, "event": "compaction_finished", "compaction_time_micros": 250265536, "output_level": 2, "num_output_files": 8, "total_output_size": 975570289, "num_input_records": 51609490, "num_output_records": 51609490, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [16, 31, 126, 23, 0, 0, 0]}
- 2018/07/27-04:39:54.553180 741ff390 EVENT_LOG_v1 {"time_micros": 1532666394553153, "job": 20, "event": "table_file_deletion", "file_number": 2319}
- 2018/07/27-04:39:54.576438 741ff390 EVENT_LOG_v1 {"time_micros": 1532666394576410, "job": 20, "event": "table_file_deletion", "file_number": 2235}
- 2018/07/27-04:39:54.677604 741ff390 EVENT_LOG_v1 {"time_micros": 1532666394677576, "job": 20, "event": "table_file_deletion", "file_number": 2192}
- 2018/07/27-04:39:54.704681 741ff390 EVENT_LOG_v1 {"time_micros": 1532666394704652, "job": 20, "event": "table_file_deletion", "file_number": 2190}
- 2018/07/27-04:39:54.705561 741ff390 EVENT_LOG_v1 {"time_micros": 1532666394705542, "job": 20, "event": "table_file_deletion", "file_number": 2189}
- 2018/07/27-04:39:54.724801 741ff390 EVENT_LOG_v1 {"time_micros": 1532666394724773, "job": 20, "event": "table_file_deletion", "file_number": 2186}
- 2018/07/27-04:39:54.725881 741ff390 EVENT_LOG_v1 {"time_micros": 1532666394725865, "job": 20, "event": "table_file_deletion", "file_number": 2185}
- 2018/07/27-04:39:54.726437 741ff390 EVENT_LOG_v1 {"time_micros": 1532666394726423, "job": 20, "event": "table_file_deletion", "file_number": 2184}
- 2018/07/27-04:39:54.747047 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 23] Compacting 1@1 + 7@2 files to L2, score 14.61
- 2018/07/27-04:39:54.747097 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 22 Base level 1, inputs: [2316(128MB)], [2250(128MB) 2251(128MB) 2254(128MB) 2255(85MB) 2239(128MB) 2240(128MB) 2242(128MB)]
- 2018/07/27-04:39:54.769343 741ff390 EVENT_LOG_v1 {"time_micros": 1532666394747128, "job": 23, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2316], "files_L2": [2250, 2251, 2254, 2255, 2239, 2240, 2242], "score": 14.6118, "input_data_size": 1034275209}
- 2018/07/27-04:40:24.295936 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 23] Generated table #2453: 7137786 keys, 134943442 bytes
- 2018/07/27-04:40:24.296155 741ff390 EVENT_LOG_v1 {"time_micros": 1532666424296082, "cf_name": "default", "job": 23, "event": "table_file_creation", "file_number": 2453, "file_size": 134943442, "table_properties": {"data_size": 134218712, "index_size": 1091153, "filter_size": 0, "raw_key_size": 178444650, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37794, "num_entries": 7137786, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:40:54.862236 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 23] Generated table #2454: 7086144 keys, 134942651 bytes
- 2018/07/27-04:40:54.888361 741ff390 EVENT_LOG_v1 {"time_micros": 1532666454888265, "cf_name": "default", "job": 23, "event": "table_file_creation", "file_number": 2454, "file_size": 134942651, "table_properties": {"data_size": 134221121, "index_size": 1083327, "filter_size": 0, "raw_key_size": 177153600, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37638, "num_entries": 7086144, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:41:26.034180 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 23] Generated table #2455: 7160744 keys, 134941718 bytes
- 2018/07/27-04:41:26.034460 741ff390 EVENT_LOG_v1 {"time_micros": 1532666486034371, "cf_name": "default", "job": 23, "event": "table_file_creation", "file_number": 2455, "file_size": 134941718, "table_properties": {"data_size": 134218560, "index_size": 1093429, "filter_size": 0, "raw_key_size": 179018600, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37760, "num_entries": 7160744, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:41:35.100167 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2457. Immutable memtables: 0.
- 2018/07/27-04:41:35.117535 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 16 level-0 files
- 2018/07/27-04:42:01.580288 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 23] Generated table #2456: 7103378 keys, 134944951 bytes
- 2018/07/27-04:42:01.580511 741ff390 EVENT_LOG_v1 {"time_micros": 1532666521580436, "cf_name": "default", "job": 23, "event": "table_file_creation", "file_number": 2456, "file_size": 134944951, "table_properties": {"data_size": 134220975, "index_size": 1086490, "filter_size": 0, "raw_key_size": 177584450, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37691, "num_entries": 7103378, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:42:35.515946 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 23] Generated table #2458: 7140206 keys, 134944184 bytes
- 2018/07/27-04:42:35.538321 741ff390 EVENT_LOG_v1 {"time_micros": 1532666555538225, "cf_name": "default", "job": 23, "event": "table_file_creation", "file_number": 2458, "file_size": 134944184, "table_properties": {"data_size": 134220169, "index_size": 1091290, "filter_size": 0, "raw_key_size": 178505150, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37770, "num_entries": 7140206, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:43:07.155633 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2460. Immutable memtables: 1.
- 2018/07/27-04:43:07.209985 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 16 level-0 files
- 2018/07/27-04:43:09.097837 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 23] Generated table #2459: 7300115 keys, 134943472 bytes
- 2018/07/27-04:43:09.098162 741ff390 EVENT_LOG_v1 {"time_micros": 1532666589097994, "cf_name": "default", "job": 23, "event": "table_file_creation", "file_number": 2459, "file_size": 134943472, "table_properties": {"data_size": 134219312, "index_size": 1110112, "filter_size": 0, "raw_key_size": 182502875, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 38081, "num_entries": 7300115, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:43:16.764964 739fe390 (Original Log Time 2018/07/27-04:43:07.278035) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:43:16.765066 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 24] Flushing memtable with next log file: 2457
- 2018/07/27-04:43:16.765083 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 24] Flushing memtable with next log file: 2460
- 2018/07/27-04:43:16.765170 739fe390 EVENT_LOG_v1 {"time_micros": 1532666596765132, "job": 24, "event": "flush_started", "num_memtables": 2, "num_entries": 4142011, "num_deletes": 0, "memory_usage": 164505520, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:43:16.873463 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 24] Level-0 flush table #2461: started
- 2018/07/27-04:43:29.707447 739fe390 EVENT_LOG_v1 {"time_micros": 1532666609707312, "cf_name": "default", "job": 24, "event": "table_file_creation", "file_number": 2461, "file_size": 101734627, "table_properties": {"data_size": 101225006, "index_size": 750701, "filter_size": 0, "raw_key_size": 117775371, "raw_average_key_size": 28, "raw_value_size": 2828828, "raw_average_value_size": 0, "num_data_blocks": 28171, "num_entries": 4130605, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:43:29.782567 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 24] Level-0 flush table #2461: 101734627 bytes OK
- 2018/07/27-04:43:29.816397 739fe390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 17 level-0 files
- 2018/07/27-04:43:29.839667 739fe390 (Original Log Time 2018/07/27-04:43:29.783408) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2461 started
- 2018/07/27-04:43:29.839692 739fe390 (Original Log Time 2018/07/27-04:43:29.816286) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2461: memtable #1 done
- 2018/07/27-04:43:29.839701 739fe390 (Original Log Time 2018/07/27-04:43:29.816300) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2461: memtable #2 done
- 2018/07/27-04:43:29.839709 739fe390 (Original Log Time 2018/07/27-04:43:29.816382) EVENT_LOG_v1 {"time_micros": 1532666609816335, "job": 24, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [17, 31, 126, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:43:29.839718 739fe390 (Original Log Time 2018/07/27-04:43:29.816465) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[17 31 126 23 0 0 0] max score 14.11
- 2018/07/27-04:43:29.839910 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 24] Try to delete WAL files size 100187338, prev total WAL file size 118336366, number of live WAL files 3.
- 2018/07/27-04:43:46.399970 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 23] Generated table #2462: 7166403 keys, 134948248 bytes
- 2018/07/27-04:43:46.400370 741ff390 EVENT_LOG_v1 {"time_micros": 1532666626400220, "cf_name": "default", "job": 23, "event": "table_file_creation", "file_number": 2462, "file_size": 134948248, "table_properties": {"data_size": 134220257, "index_size": 1095981, "filter_size": 0, "raw_key_size": 179160075, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37906, "num_entries": 7166403, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:44:05.866059 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 23] Generated table #2463: 4155528 keys, 77462229 bytes
- 2018/07/27-04:44:05.948268 741ff390 EVENT_LOG_v1 {"time_micros": 1532666645948186, "cf_name": "default", "job": 23, "event": "table_file_creation", "file_number": 2463, "file_size": 77462229, "table_properties": {"data_size": 77046582, "index_size": 632994, "filter_size": 0, "raw_key_size": 103888200, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 21772, "num_entries": 4155528, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:44:05.949661 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 23] Compacted 1@1 + 7@2 files to L2 => 1022070895 bytes
- 2018/07/27-04:44:05.982893 741ff390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 17 level-0 files
- 2018/07/27-04:44:06.015087 741ff390 (Original Log Time 2018/07/27-04:44:05.982758) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[17 30 127 23 0 0 0] max score 14.11, MB/sec: 4.1 rd, 4.1 wr, level 2, files in(1, 7) out(8) MB in(128.7, 857.7) out(974.7), read-write-amplify(15.2) write-amplify(7.6) OK, records in: 6766871, records dropped: 0 output_compression: Snappy
- 2018/07/27-04:44:06.015126 741ff390 (Original Log Time 2018/07/27-04:44:05.982873) EVENT_LOG_v1 {"time_micros": 1532666645982810, "job": 23, "event": "compaction_finished", "compaction_time_micros": 251180091, "output_level": 2, "num_output_files": 8, "total_output_size": 1022070895, "num_input_records": 54250304, "num_output_records": 54250304, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [17, 30, 127, 23, 0, 0, 0]}
- 2018/07/27-04:44:06.078397 741ff390 EVENT_LOG_v1 {"time_micros": 1532666646078370, "job": 23, "event": "table_file_deletion", "file_number": 2316}
- 2018/07/27-04:44:06.087218 741ff390 EVENT_LOG_v1 {"time_micros": 1532666646087193, "job": 23, "event": "table_file_deletion", "file_number": 2255}
- 2018/07/27-04:44:06.095145 741ff390 EVENT_LOG_v1 {"time_micros": 1532666646095122, "job": 23, "event": "table_file_deletion", "file_number": 2254}
- 2018/07/27-04:44:06.117537 741ff390 EVENT_LOG_v1 {"time_micros": 1532666646117509, "job": 23, "event": "table_file_deletion", "file_number": 2251}
- 2018/07/27-04:44:06.140354 741ff390 EVENT_LOG_v1 {"time_micros": 1532666646140327, "job": 23, "event": "table_file_deletion", "file_number": 2250}
- 2018/07/27-04:44:06.205066 741ff390 EVENT_LOG_v1 {"time_micros": 1532666646205038, "job": 23, "event": "table_file_deletion", "file_number": 2242}
- 2018/07/27-04:44:06.234989 741ff390 EVENT_LOG_v1 {"time_micros": 1532666646234961, "job": 23, "event": "table_file_deletion", "file_number": 2240}
- 2018/07/27-04:44:06.246204 741ff390 EVENT_LOG_v1 {"time_micros": 1532666646246177, "job": 23, "event": "table_file_deletion", "file_number": 2239}
- 2018/07/27-04:44:06.263072 741ff390 [WARN] [rocksdb/db/db_impl.cc:491] ------- DUMPING STATS -------
- 2018/07/27-04:44:06.263214 741ff390 [WARN] [rocksdb/db/db_impl.cc:492]
- ** DB Stats **
- Uptime(secs): 2327.6 total, 784.6 interval
- Cumulative writes: 57 writes, 50M keys, 57 commit groups, 1.0 writes per commit group, ingest: 1.14 GB, 0.50 MB/s
- Cumulative WAL: 57 writes, 57 syncs, 0.98 writes per sync, written: 1.14 GB, 0.50 MB/s
- Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- Interval writes: 20 writes, 17M keys, 20 commit groups, 1.0 writes per commit group, ingest: 396.88 MB, 0.51 MB/s
- Interval WAL: 20 writes, 20 syncs, 0.95 writes per sync, written: 0.39 MB, 0.51 MB/s
- Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- ** Compaction Stats [default] **
- Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- ----------------------------------------------------------------------------------------------------------------------------------------------------------
- L0 17/0 1.30 GB 5.2 0.0 0.0 0.0 1.1 1.1 0.0 1.0 0.0 5.9 196 14 13.981 0 0
- L1 30/0 3.53 GB 14.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L2 127/0 15.26 GB 6.1 8.6 1.1 7.5 8.5 1.1 0.0 7.5 3.8 3.8 2324 9 258.271 91M 2
- L3 23/0 2.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Sum 197/0 22.64 GB 0.0 8.6 1.1 7.5 9.7 2.2 0.0 8.6 3.5 3.9 2520 23 109.573 91M 2
- Int 0/0 0.00 KB 0.0 3.0 0.4 2.6 3.4 0.8 0.0 7.7 3.6 4.1 850 8 106.248 23M 1
- Uptime(secs): 2327.6 total, 784.6 interval
- Flush(GB): cumulative 1.126, interval 0.439
- AddFile(GB): cumulative 0.000, interval 0.000
- AddFile(Total Files): cumulative 0, interval 0
- AddFile(L0 Files): cumulative 0, interval 0
- AddFile(Keys): cumulative 0, interval 0
- Cumulative compaction: 9.66 GB write, 4.25 MB/s write, 8.61 GB read, 3.79 MB/s read, 2520.2 seconds
- Interval compaction: 3.37 GB write, 4.40 MB/s write, 2.96 GB read, 3.87 MB/s read, 850.0 seconds
- Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- ** File Read Latency Histogram By Level [default] **
- ** Compaction Stats [default] **
- Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- ----------------------------------------------------------------------------------------------------------------------------------------------------------
- L0 17/0 1.30 GB 5.2 0.0 0.0 0.0 1.1 1.1 0.0 1.0 0.0 5.9 196 14 13.981 0 0
- L1 30/0 3.53 GB 14.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L2 127/0 15.26 GB 6.1 8.6 1.1 7.5 8.5 1.1 0.0 7.5 3.8 3.8 2324 9 258.271 91M 2
- L3 23/0 2.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Sum 197/0 22.64 GB 0.0 8.6 1.1 7.5 9.7 2.2 0.0 8.6 3.5 3.9 2520 23 109.573 91M 2
- Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Uptime(secs): 2327.6 total, 0.0 interval
- Flush(GB): cumulative 1.126, interval 0.000
- AddFile(GB): cumulative 0.000, interval 0.000
- AddFile(Total Files): cumulative 0, interval 0
- AddFile(L0 Files): cumulative 0, interval 0
- AddFile(Keys): cumulative 0, interval 0
- Cumulative compaction: 9.66 GB write, 4.25 MB/s write, 8.61 GB read, 3.79 MB/s read, 2520.2 seconds
- Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- ** File Read Latency Histogram By Level [default] **
- 2018/07/27-04:44:06.263507 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 25] Compacting 1@1 + 8@2 files to L2, score 14.11
- 2018/07/27-04:44:06.263540 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 24 Base level 1, inputs: [2317(128MB)], [2463(73MB) 2243(128MB) 2246(128MB) 2247(116MB) 2226(128MB) 2227(128MB) 2228(128MB) 2229(128MB)]
- 2018/07/27-04:44:06.273100 741ff390 EVENT_LOG_v1 {"time_micros": 1532666646263571, "job": 25, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2317], "files_L2": [2463, 2243, 2246, 2247, 2226, 2227, 2228, 2229], "score": 14.1092, "input_data_size": 1143701661}
- 2018/07/27-04:44:28.452238 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2465. Immutable memtables: 0.
- 2018/07/27-04:44:28.452467 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 17 level-0 files
- 2018/07/27-04:44:39.176004 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 25] Generated table #2464: 7307323 keys, 134944763 bytes
- 2018/07/27-04:44:39.280624 741ff390 EVENT_LOG_v1 {"time_micros": 1532666679280521, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 2464, "file_size": 134944763, "table_properties": {"data_size": 134221138, "index_size": 1112126, "filter_size": 0, "raw_key_size": 182683075, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 38045, "num_entries": 7307323, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:45:11.819660 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 25] Generated table #2466: 7139022 keys, 134947535 bytes
- 2018/07/27-04:45:11.837974 741ff390 EVENT_LOG_v1 {"time_micros": 1532666711837867, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 2466, "file_size": 134947535, "table_properties": {"data_size": 134219756, "index_size": 1091289, "filter_size": 0, "raw_key_size": 178475550, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37884, "num_entries": 7139022, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:45:48.573216 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 25] Generated table #2467: 7132847 keys, 134946048 bytes
- 2018/07/27-04:45:48.612860 741ff390 EVENT_LOG_v1 {"time_micros": 1532666748612755, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 2467, "file_size": 134946048, "table_properties": {"data_size": 134219025, "index_size": 1090699, "filter_size": 0, "raw_key_size": 178321175, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37851, "num_entries": 7132847, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:45:55.429591 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2469. Immutable memtables: 1.
- 2018/07/27-04:45:55.455223 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 17 level-0 files
- 2018/07/27-04:46:06.643539 739fe390 (Original Log Time 2018/07/27-04:45:55.456015) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:46:06.699438 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 26] Flushing memtable with next log file: 2465
- 2018/07/27-04:46:06.699505 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 26] Flushing memtable with next log file: 2469
- 2018/07/27-04:46:06.699839 739fe390 EVENT_LOG_v1 {"time_micros": 1532666766699711, "job": 26, "event": "flush_started", "num_memtables": 2, "num_entries": 3821517, "num_deletes": 0, "memory_usage": 152731920, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:46:06.701895 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 26] Level-0 flush table #2470: started
- 2018/07/27-04:46:22.156487 739fe390 EVENT_LOG_v1 {"time_micros": 1532666782156385, "cf_name": "default", "job": 26, "event": "table_file_creation", "file_number": 2470, "file_size": 95223785, "table_properties": {"data_size": 94752567, "index_size": 695374, "filter_size": 0, "raw_key_size": 109081724, "raw_average_key_size": 28, "raw_value_size": 2670356, "raw_average_value_size": 0, "num_data_blocks": 26253, "num_entries": 3817260, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:46:22.156616 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 26] Level-0 flush table #2470: 95223785 bytes OK
- 2018/07/27-04:46:22.222661 739fe390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 18 level-0 files
- 2018/07/27-04:46:22.222808 739fe390 (Original Log Time 2018/07/27-04:46:22.157420) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2470 started
- 2018/07/27-04:46:22.222819 739fe390 (Original Log Time 2018/07/27-04:46:22.222545) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2470: memtable #1 done
- 2018/07/27-04:46:22.222828 739fe390 (Original Log Time 2018/07/27-04:46:22.222558) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2470: memtable #2 done
- 2018/07/27-04:46:22.222836 739fe390 (Original Log Time 2018/07/27-04:46:22.222642) EVENT_LOG_v1 {"time_micros": 1532666782222594, "job": 26, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [18, 30, 127, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:46:22.222845 739fe390 (Original Log Time 2018/07/27-04:46:22.222742) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[18 30 127 23 0 0 0] max score 13.61
- 2018/07/27-04:46:22.223071 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 26] Try to delete WAL files size 92757352, prev total WAL file size 116162370, number of live WAL files 3.
- 2018/07/27-04:46:26.134699 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 25] Generated table #2468: 7180417 keys, 134944545 bytes
- 2018/07/27-04:46:26.134829 741ff390 EVENT_LOG_v1 {"time_micros": 1532666786134757, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 2468, "file_size": 134944545, "table_properties": {"data_size": 134218879, "index_size": 1096430, "filter_size": 0, "raw_key_size": 179510425, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37879, "num_entries": 7180417, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:47:03.360112 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 25] Generated table #2471: 7179083 keys, 134945607 bytes
- 2018/07/27-04:47:03.360359 741ff390 EVENT_LOG_v1 {"time_micros": 1532666823360265, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 2471, "file_size": 134945607, "table_properties": {"data_size": 134220231, "index_size": 1096734, "filter_size": 0, "raw_key_size": 179477075, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37877, "num_entries": 7179083, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:47:32.514783 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 25] Generated table #2472: 7409459 keys, 134944854 bytes
- 2018/07/27-04:47:32.572260 741ff390 EVENT_LOG_v1 {"time_micros": 1532666852572153, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 2472, "file_size": 134944854, "table_properties": {"data_size": 134220226, "index_size": 1125256, "filter_size": 0, "raw_key_size": 185236475, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 38315, "num_entries": 7409459, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:48:02.992621 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 25] Generated table #2473: 7193864 keys, 134945316 bytes
- 2018/07/27-04:48:02.992918 741ff390 EVENT_LOG_v1 {"time_micros": 1532666882992824, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 2473, "file_size": 134945316, "table_properties": {"data_size": 134220922, "index_size": 1097601, "filter_size": 0, "raw_key_size": 179846600, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37878, "num_entries": 7193864, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:48:33.345734 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 25] Generated table #2474: 7181975 keys, 134946343 bytes
- 2018/07/27-04:48:33.380380 741ff390 EVENT_LOG_v1 {"time_micros": 1532666913380290, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 2474, "file_size": 134946343, "table_properties": {"data_size": 134220055, "index_size": 1097005, "filter_size": 0, "raw_key_size": 179549375, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37915, "num_entries": 7181975, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:48:43.717305 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 25] Generated table #2475: 2720952 keys, 51816079 bytes
- 2018/07/27-04:48:43.717530 741ff390 EVENT_LOG_v1 {"time_micros": 1532666923717455, "cf_name": "default", "job": 25, "event": "table_file_creation", "file_number": 2475, "file_size": 51816079, "table_properties": {"data_size": 51537494, "index_size": 416228, "filter_size": 0, "raw_key_size": 68023800, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 14473, "num_entries": 2720952, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:48:43.769377 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 25] Compacted 1@1 + 8@2 files to L2 => 1131381090 bytes
- 2018/07/27-04:48:43.831468 741ff390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 18 level-0 files
- 2018/07/27-04:48:43.833362 741ff390 (Original Log Time 2018/07/27-04:48:43.831315) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[18 29 128 23 0 0 0] max score 13.61, MB/sec: 4.1 rd, 4.1 wr, level 2, files in(1, 8) out(9) MB in(128.7, 962.0) out(1079.0), read-write-amplify(16.9) write-amplify(8.4) OK, records in: 10882923, records dropped: 0 output_compression: Snappy
- 2018/07/27-04:48:43.833388 741ff390 (Original Log Time 2018/07/27-04:48:43.831431) EVENT_LOG_v1 {"time_micros": 1532666923831367, "job": 25, "event": "compaction_finished", "compaction_time_micros": 277495981, "output_level": 2, "num_output_files": 9, "total_output_size": 1131381090, "num_input_records": 60444942, "num_output_records": 60444942, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [18, 29, 128, 23, 0, 0, 0]}
- 2018/07/27-04:48:43.900526 741ff390 EVENT_LOG_v1 {"time_micros": 1532666923900501, "job": 25, "event": "table_file_deletion", "file_number": 2463}
- 2018/07/27-04:48:43.938331 741ff390 EVENT_LOG_v1 {"time_micros": 1532666923938303, "job": 25, "event": "table_file_deletion", "file_number": 2317}
- 2018/07/27-04:48:43.998342 741ff390 EVENT_LOG_v1 {"time_micros": 1532666923998316, "job": 25, "event": "table_file_deletion", "file_number": 2247}
- 2018/07/27-04:48:44.029893 741ff390 EVENT_LOG_v1 {"time_micros": 1532666924029871, "job": 25, "event": "table_file_deletion", "file_number": 2246}
- 2018/07/27-04:48:44.030781 741ff390 EVENT_LOG_v1 {"time_micros": 1532666924030764, "job": 25, "event": "table_file_deletion", "file_number": 2243}
- 2018/07/27-04:48:44.109251 741ff390 EVENT_LOG_v1 {"time_micros": 1532666924109224, "job": 25, "event": "table_file_deletion", "file_number": 2229}
- 2018/07/27-04:48:44.130744 741ff390 EVENT_LOG_v1 {"time_micros": 1532666924130715, "job": 25, "event": "table_file_deletion", "file_number": 2228}
- 2018/07/27-04:48:44.143178 741ff390 EVENT_LOG_v1 {"time_micros": 1532666924143152, "job": 25, "event": "table_file_deletion", "file_number": 2227}
- 2018/07/27-04:48:44.160864 741ff390 EVENT_LOG_v1 {"time_micros": 1532666924160837, "job": 25, "event": "table_file_deletion", "file_number": 2226}
- 2018/07/27-04:48:44.161385 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 27] Compacting 1@1 + 6@2 files to L2, score 13.61
- 2018/07/27-04:48:44.161428 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 26 Base level 1, inputs: [2320(128MB)], [2451(128MB) 2452(29MB) 2193(128MB) 2196(103MB) 1940(128MB) 1941(128MB)]
- 2018/07/27-04:48:44.170982 741ff390 EVENT_LOG_v1 {"time_micros": 1532666924161453, "job": 27, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2320], "files_L2": [2451, 2452, 2193, 2196, 1940, 1941], "score": 13.6066, "input_data_size": 813970558}
- 2018/07/27-04:49:14.302236 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 27] Generated table #2476: 7191316 keys, 134943029 bytes
- 2018/07/27-04:49:14.302468 741ff390 EVENT_LOG_v1 {"time_micros": 1532666954302391, "cf_name": "default", "job": 27, "event": "table_file_creation", "file_number": 2476, "file_size": 134943029, "table_properties": {"data_size": 134218322, "index_size": 1097424, "filter_size": 0, "raw_key_size": 179782900, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37880, "num_entries": 7191316, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:49:49.226643 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 27] Generated table #2477: 7348970 keys, 134942690 bytes
- 2018/07/27-04:49:49.255016 741ff390 EVENT_LOG_v1 {"time_micros": 1532666989254912, "cf_name": "default", "job": 27, "event": "table_file_creation", "file_number": 2477, "file_size": 134942690, "table_properties": {"data_size": 134218309, "index_size": 1117514, "filter_size": 0, "raw_key_size": 183724250, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 38148, "num_entries": 7348970, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:49:49.737465 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2479. Immutable memtables: 0.
- 2018/07/27-04:49:49.737535 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 18 level-0 files
- 2018/07/27-04:50:20.937371 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 27] Generated table #2478: 7202923 keys, 134947713 bytes
- 2018/07/27-04:50:20.937644 741ff390 EVENT_LOG_v1 {"time_micros": 1532667020937555, "cf_name": "default", "job": 27, "event": "table_file_creation", "file_number": 2478, "file_size": 134947713, "table_properties": {"data_size": 134220081, "index_size": 1099957, "filter_size": 0, "raw_key_size": 180073075, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37947, "num_entries": 7202923, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:50:52.369816 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 27] Generated table #2480: 7146081 keys, 134945831 bytes
- 2018/07/27-04:50:52.431847 741ff390 EVENT_LOG_v1 {"time_micros": 1532667052431761, "cf_name": "default", "job": 27, "event": "table_file_creation", "file_number": 2480, "file_size": 134945831, "table_properties": {"data_size": 134218606, "index_size": 1092948, "filter_size": 0, "raw_key_size": 178652025, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37870, "num_entries": 7146081, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:51:28.741638 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 27] Generated table #2481: 7117767 keys, 134947111 bytes
- 2018/07/27-04:51:28.864263 741ff390 EVENT_LOG_v1 {"time_micros": 1532667088863894, "cf_name": "default", "job": 27, "event": "table_file_creation", "file_number": 2481, "file_size": 134947111, "table_properties": {"data_size": 134219328, "index_size": 1089452, "filter_size": 0, "raw_key_size": 177944175, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37833, "num_entries": 7117767, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:52:02.373526 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 27] Generated table #2482: 6707876 keys, 126945589 bytes
- 2018/07/27-04:52:02.461380 741ff390 EVENT_LOG_v1 {"time_micros": 1532667122461287, "cf_name": "default", "job": 27, "event": "table_file_creation", "file_number": 2482, "file_size": 126945589, "table_properties": {"data_size": 126261762, "index_size": 1026621, "filter_size": 0, "raw_key_size": 167696900, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 35593, "num_entries": 6707876, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:52:02.563549 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 27] Compacted 1@1 + 6@2 files to L2 => 801671963 bytes
- 2018/07/27-04:52:02.606322 741ff390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 18 level-0 files
- 2018/07/27-04:52:02.614309 741ff390 (Original Log Time 2018/07/27-04:52:02.606152) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[18 28 128 23 0 0 0] max score 13.10, MB/sec: 4.1 rd, 4.0 wr, level 2, files in(1, 6) out(6) MB in(128.7, 647.6) out(764.5), read-write-amplify(12.0) write-amplify(5.9) OK, records in: 15619276, records dropped: 0 output_compression: Snappy
- 2018/07/27-04:52:02.614351 741ff390 (Original Log Time 2018/07/27-04:52:02.606297) EVENT_LOG_v1 {"time_micros": 1532667122606232, "job": 27, "event": "compaction_finished", "compaction_time_micros": 198392236, "output_level": 2, "num_output_files": 6, "total_output_size": 801671963, "num_input_records": 42714933, "num_output_records": 42714933, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [18, 28, 128, 23, 0, 0, 0]}
- 2018/07/27-04:52:02.737900 741ff390 EVENT_LOG_v1 {"time_micros": 1532667122737871, "job": 27, "event": "table_file_deletion", "file_number": 2452}
- 2018/07/27-04:52:02.759661 741ff390 EVENT_LOG_v1 {"time_micros": 1532667122759630, "job": 27, "event": "table_file_deletion", "file_number": 2451}
- 2018/07/27-04:52:02.824439 741ff390 EVENT_LOG_v1 {"time_micros": 1532667122824380, "job": 27, "event": "table_file_deletion", "file_number": 2320}
- 2018/07/27-04:52:02.848905 741ff390 EVENT_LOG_v1 {"time_micros": 1532667122848877, "job": 27, "event": "table_file_deletion", "file_number": 2196}
- 2018/07/27-04:52:02.926579 741ff390 EVENT_LOG_v1 {"time_micros": 1532667122926541, "job": 27, "event": "table_file_deletion", "file_number": 2193}
- 2018/07/27-04:52:02.971144 741ff390 EVENT_LOG_v1 {"time_micros": 1532667122971114, "job": 27, "event": "table_file_deletion", "file_number": 1941}
- 2018/07/27-04:52:03.027377 741ff390 EVENT_LOG_v1 {"time_micros": 1532667123027341, "job": 27, "event": "table_file_deletion", "file_number": 1940}
- 2018/07/27-04:52:03.061326 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 28] Compacting 1@1 + 5@2 files to L2, score 13.10
- 2018/07/27-04:52:03.061374 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 27 Base level 1, inputs: [2312(128MB)], [2178(128MB) 2181(78MB) 1961(128MB) 1962(128MB) 1963(128MB)]
- 2018/07/27-04:52:03.074309 741ff390 EVENT_LOG_v1 {"time_micros": 1532667123061406, "job": 28, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2312], "files_L2": [2178, 2181, 1961, 1962, 1963], "score": 13.104, "input_data_size": 757316503}
- 2018/07/27-04:52:28.298448 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2484. Immutable memtables: 1.
- 2018/07/27-04:52:28.321105 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 18 level-0 files
- 2018/07/27-04:52:35.037478 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 28] Generated table #2483: 7195498 keys, 134946671 bytes
- 2018/07/27-04:52:35.037909 741ff390 EVENT_LOG_v1 {"time_micros": 1532667155037748, "cf_name": "default", "job": 28, "event": "table_file_creation", "file_number": 2483, "file_size": 134946671, "table_properties": {"data_size": 134220970, "index_size": 1098288, "filter_size": 0, "raw_key_size": 179887450, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37937, "num_entries": 7195498, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:52:38.001783 739fe390 (Original Log Time 2018/07/27-04:52:28.321241) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:52:38.001844 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 29] Flushing memtable with next log file: 2479
- 2018/07/27-04:52:38.001875 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 29] Flushing memtable with next log file: 2484
- 2018/07/27-04:52:38.002109 739fe390 EVENT_LOG_v1 {"time_micros": 1532667158002026, "job": 29, "event": "flush_started", "num_memtables": 2, "num_entries": 3651558, "num_deletes": 0, "memory_usage": 145646116, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:52:38.002147 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 29] Level-0 flush table #2485: started
- 2018/07/27-04:52:49.772775 739fe390 EVENT_LOG_v1 {"time_micros": 1532667169772584, "cf_name": "default", "job": 29, "event": "table_file_creation", "file_number": 2485, "file_size": 91198828, "table_properties": {"data_size": 90747620, "index_size": 665584, "filter_size": 0, "raw_key_size": 104320156, "raw_average_key_size": 28, "raw_value_size": 2592272, "raw_average_value_size": 0, "num_data_blocks": 25130, "num_entries": 3645468, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:52:49.773065 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 29] Level-0 flush table #2485: 91198828 bytes OK
- 2018/07/27-04:52:49.839125 739fe390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 19 level-0 files
- 2018/07/27-04:52:49.839325 739fe390 (Original Log Time 2018/07/27-04:52:49.774265) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2485 started
- 2018/07/27-04:52:49.839348 739fe390 (Original Log Time 2018/07/27-04:52:49.838923) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2485: memtable #1 done
- 2018/07/27-04:52:49.839367 739fe390 (Original Log Time 2018/07/27-04:52:49.838947) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2485: memtable #2 done
- 2018/07/27-04:52:49.839387 739fe390 (Original Log Time 2018/07/27-04:52:49.839098) EVENT_LOG_v1 {"time_micros": 1532667169839009, "job": 29, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [19, 28, 128, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:52:49.839406 739fe390 (Original Log Time 2018/07/27-04:52:49.839224) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[19 28 128 23 0 0 0] max score 12.60
- 2018/07/27-04:52:49.839874 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 29] Try to delete WAL files size 88813320, prev total WAL file size 109513988, number of live WAL files 3.
- 2018/07/27-04:53:11.881593 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 28] Generated table #2486: 7188548 keys, 134945772 bytes
- 2018/07/27-04:53:11.881799 741ff390 EVENT_LOG_v1 {"time_micros": 1532667191881726, "cf_name": "default", "job": 28, "event": "table_file_creation", "file_number": 2486, "file_size": 134945772, "table_properties": {"data_size": 134220004, "index_size": 1097833, "filter_size": 0, "raw_key_size": 179713700, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37910, "num_entries": 7188548, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:53:48.385373 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 28] Generated table #2487: 7163522 keys, 134945870 bytes
- 2018/07/27-04:53:48.390985 741ff390 EVENT_LOG_v1 {"time_micros": 1532667228390887, "cf_name": "default", "job": 28, "event": "table_file_creation", "file_number": 2487, "file_size": 134945870, "table_properties": {"data_size": 134218808, "index_size": 1095085, "filter_size": 0, "raw_key_size": 179088050, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37908, "num_entries": 7163522, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:54:11.663241 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2489. Immutable memtables: 0.
- 2018/07/27-04:54:11.663484 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 19 level-0 files
- 2018/07/27-04:54:30.000717 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 28] Generated table #2488: 7219334 keys, 134946469 bytes
- 2018/07/27-04:54:30.047808 741ff390 EVENT_LOG_v1 {"time_micros": 1532667270047696, "cf_name": "default", "job": 28, "event": "table_file_creation", "file_number": 2488, "file_size": 134946469, "table_properties": {"data_size": 134219652, "index_size": 1102018, "filter_size": 0, "raw_key_size": 180483350, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37973, "num_entries": 7219334, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:55:03.258813 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 28] Generated table #2490: 7186363 keys, 134945925 bytes
- 2018/07/27-04:55:03.291438 741ff390 EVENT_LOG_v1 {"time_micros": 1532667303291250, "cf_name": "default", "job": 28, "event": "table_file_creation", "file_number": 2490, "file_size": 134945925, "table_properties": {"data_size": 134221700, "index_size": 1096766, "filter_size": 0, "raw_key_size": 179659075, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37860, "num_entries": 7186363, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:55:19.976488 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 28] Generated table #2491: 3908638 keys, 70425165 bytes
- 2018/07/27-04:55:19.976696 741ff390 EVENT_LOG_v1 {"time_micros": 1532667319976623, "cf_name": "default", "job": 28, "event": "table_file_creation", "file_number": 2491, "file_size": 70425165, "table_properties": {"data_size": 70049829, "index_size": 591335, "filter_size": 0, "raw_key_size": 97715950, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 19954, "num_entries": 3908638, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:55:20.099040 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 28] Compacted 1@1 + 5@2 files to L2 => 745155872 bytes
- 2018/07/27-04:55:20.151486 741ff390 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 19 level-0 files
- 2018/07/27-04:55:20.153410 741ff390 (Original Log Time 2018/07/27-04:55:20.151315) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[19 27 129 23 0 0 0] max score 12.60, MB/sec: 3.8 rd, 3.8 wr, level 2, files in(1, 5) out(6) MB in(128.7, 593.6) out(710.6), read-write-amplify(11.1) write-amplify(5.5) OK, records in: 6677336, records dropped: 0 output_compression: Snappy
- 2018/07/27-04:55:20.153439 741ff390 (Original Log Time 2018/07/27-04:55:20.151462) EVENT_LOG_v1 {"time_micros": 1532667320151397, "job": 28, "event": "compaction_finished", "compaction_time_micros": 197024450, "output_level": 2, "num_output_files": 6, "total_output_size": 745155872, "num_input_records": 39861903, "num_output_records": 39861903, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [19, 27, 129, 23, 0, 0, 0]}
- 2018/07/27-04:55:20.250172 741ff390 EVENT_LOG_v1 {"time_micros": 1532667320250145, "job": 28, "event": "table_file_deletion", "file_number": 2312}
- 2018/07/27-04:55:20.316886 741ff390 EVENT_LOG_v1 {"time_micros": 1532667320316860, "job": 28, "event": "table_file_deletion", "file_number": 2181}
- 2018/07/27-04:55:20.317532 741ff390 EVENT_LOG_v1 {"time_micros": 1532667320317516, "job": 28, "event": "table_file_deletion", "file_number": 2178}
- 2018/07/27-04:55:20.386645 741ff390 EVENT_LOG_v1 {"time_micros": 1532667320386615, "job": 28, "event": "table_file_deletion", "file_number": 1963}
- 2018/07/27-04:55:20.398587 741ff390 EVENT_LOG_v1 {"time_micros": 1532667320398559, "job": 28, "event": "table_file_deletion", "file_number": 1962}
- 2018/07/27-04:55:20.428525 741ff390 EVENT_LOG_v1 {"time_micros": 1532667320428498, "job": 28, "event": "table_file_deletion", "file_number": 1961}
- 2018/07/27-04:55:20.491058 741ff390 [WARN] [rocksdb/db/db_impl.cc:491] ------- DUMPING STATS -------
- 2018/07/27-04:55:20.491185 741ff390 [WARN] [rocksdb/db/db_impl.cc:492]
- ** DB Stats **
- Uptime(secs): 3001.8 total, 674.2 interval
- Cumulative writes: 68 writes, 60M keys, 68 commit groups, 1.0 writes per commit group, ingest: 1.36 GB, 0.46 MB/s
- Cumulative WAL: 68 writes, 68 syncs, 0.99 writes per sync, written: 1.36 GB, 0.46 MB/s
- Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
- Interval writes: 11 writes, 9812K keys, 11 commit groups, 0.9 writes per commit group, ingest: 226.87 MB, 0.34 MB/s
- Interval WAL: 11 writes, 11 syncs, 0.92 writes per sync, written: 0.22 MB, 0.34 MB/s
- Interval stall: 00:00:0.000 H:M:S, 0.0 percent
- ** Compaction Stats [default] **
- Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- ----------------------------------------------------------------------------------------------------------------------------------------------------------
- L0 19/0 1.48 GB 5.9 0.0 0.0 0.0 1.3 1.3 0.0 1.0 0.0 6.0 223 16 13.938 0 0
- L1 27/0 3.15 GB 12.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L2 129/0 15.61 GB 6.2 11.1 1.5 9.6 11.0 1.4 0.0 7.3 3.8 3.8 2997 12 249.779 124M 2
- L3 23/0 2.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Sum 198/0 22.78 GB 0.0 11.1 1.5 9.6 12.3 2.7 0.0 9.5 3.5 3.9 3220 28 115.013 124M 2
- Int 0/0 0.00 KB 0.0 2.5 0.4 2.2 2.7 0.5 0.0 15.4 3.7 3.9 700 5 140.040 33M 0
- Uptime(secs): 3001.8 total, 674.2 interval
- Flush(GB): cumulative 1.299, interval 0.174
- AddFile(GB): cumulative 0.000, interval 0.000
- AddFile(Total Files): cumulative 0, interval 0
- AddFile(L0 Files): cumulative 0, interval 0
- AddFile(Keys): cumulative 0, interval 0
- Cumulative compaction: 12.33 GB write, 4.21 MB/s write, 11.14 GB read, 3.80 MB/s read, 3220.4 seconds
- Interval compaction: 2.67 GB write, 4.05 MB/s write, 2.53 GB read, 3.84 MB/s read, 700.2 seconds
- Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- ** File Read Latency Histogram By Level [default] **
- ** Compaction Stats [default] **
- Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- ----------------------------------------------------------------------------------------------------------------------------------------------------------
- L0 19/0 1.48 GB 5.9 0.0 0.0 0.0 1.3 1.3 0.0 1.0 0.0 6.0 223 16 13.938 0 0
- L1 27/0 3.15 GB 12.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L2 129/0 15.61 GB 6.2 11.1 1.5 9.6 11.0 1.4 0.0 7.3 3.8 3.8 2997 12 249.779 124M 2
- L3 23/0 2.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Sum 198/0 22.78 GB 0.0 11.1 1.5 9.6 12.3 2.7 0.0 9.5 3.5 3.9 3220 28 115.013 124M 2
- Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Uptime(secs): 3001.8 total, 0.0 interval
- Flush(GB): cumulative 1.299, interval 0.000
- AddFile(GB): cumulative 0.000, interval 0.000
- AddFile(Total Files): cumulative 0, interval 0
- AddFile(L0 Files): cumulative 0, interval 0
- AddFile(Keys): cumulative 0, interval 0
- Cumulative compaction: 12.33 GB write, 4.21 MB/s write, 11.14 GB read, 3.80 MB/s read, 3220.4 seconds
- Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- ** File Read Latency Histogram By Level [default] **
- 2018/07/27-04:55:20.491469 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 30] Compacting 1@1 + 6@2 files to L2, score 12.60
- 2018/07/27-04:55:20.491496 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 29 Base level 1, inputs: [2313(128MB)], [2490(128MB) 2491(67MB) 1965(128MB) 1966(128MB) 2248(128MB) 2453(128MB)]
- 2018/07/27-04:55:20.491584 741ff390 EVENT_LOG_v1 {"time_micros": 1532667320491527, "job": 30, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2313], "files_L2": [2490, 2491, 1965, 1966, 2248, 2453], "score": 12.6014, "input_data_size": 880049677}
- 2018/07/27-04:55:37.099000 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2493. Immutable memtables: 1.
- 2018/07/27-04:55:37.121354 76f71d30 [rocksdb/db/column_family.cc:837] [default] Increasing compaction threads because we have 19 level-0 files
- 2018/07/27-04:55:47.082541 739fe390 (Original Log Time 2018/07/27-04:55:37.121475) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:55:47.150771 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 31] Flushing memtable with next log file: 2489
- 2018/07/27-04:55:47.150818 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 31] Flushing memtable with next log file: 2493
- 2018/07/27-04:55:47.150957 739fe390 EVENT_LOG_v1 {"time_micros": 1532667347150905, "job": 31, "event": "flush_started", "num_memtables": 2, "num_entries": 4040079, "num_deletes": 0, "memory_usage": 159141392, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:55:47.150976 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 31] Level-0 flush table #2494: started
- 2018/07/27-04:55:56.774202 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 30] Generated table #2492: 7159265 keys, 134948454 bytes
- 2018/07/27-04:55:56.774401 741ff390 EVENT_LOG_v1 {"time_micros": 1532667356774315, "cf_name": "default", "job": 30, "event": "table_file_creation", "file_number": 2492, "file_size": 134948454, "table_properties": {"data_size": 134220417, "index_size": 1094811, "filter_size": 0, "raw_key_size": 178981625, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37910, "num_entries": 7159265, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:56:02.048066 739fe390 EVENT_LOG_v1 {"time_micros": 1532667362047969, "cf_name": "default", "job": 31, "event": "table_file_creation", "file_number": 2494, "file_size": 99046339, "table_properties": {"data_size": 98552338, "index_size": 727686, "filter_size": 0, "raw_key_size": 114293040, "raw_average_key_size": 28, "raw_value_size": 2677012, "raw_average_value_size": 0, "num_data_blocks": 27448, "num_entries": 4016350, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:56:02.048189 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 31] Level-0 flush table #2494: 99046339 bytes OK
- 2018/07/27-04:56:02.085886 739fe390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 20 level-0 files rate 16777216
- 2018/07/27-04:56:02.086170 739fe390 (Original Log Time 2018/07/27-04:56:02.049199) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2494 started
- 2018/07/27-04:56:02.086195 739fe390 (Original Log Time 2018/07/27-04:56:02.085660) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2494: memtable #1 done
- 2018/07/27-04:56:02.086214 739fe390 (Original Log Time 2018/07/27-04:56:02.085677) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2494: memtable #2 done
- 2018/07/27-04:56:02.086234 739fe390 (Original Log Time 2018/07/27-04:56:02.085838) EVENT_LOG_v1 {"time_micros": 1532667362085739, "job": 31, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [20, 27, 129, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:56:02.086254 739fe390 (Original Log Time 2018/07/27-04:56:02.086042) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[20 27 129 23 0 0 0] max score 12.10
- 2018/07/27-04:56:02.086760 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 31] Try to delete WAL files size 97370926, prev total WAL file size 121603130, number of live WAL files 3.
- 2018/07/27-04:56:34.839406 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 30] Generated table #2495: 7428908 keys, 134941684 bytes
- 2018/07/27-04:56:34.907139 741ff390 EVENT_LOG_v1 {"time_micros": 1532667394907034, "cf_name": "default", "job": 30, "event": "table_file_creation", "file_number": 2495, "file_size": 134941684, "table_properties": {"data_size": 134220176, "index_size": 1127294, "filter_size": 0, "raw_key_size": 185722700, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 38246, "num_entries": 7428908, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:56:50.863060 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2497. Immutable memtables: 0.
- 2018/07/27-04:56:50.863351 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 20 level-0 files rate 13421772
- 2018/07/27-04:57:07.762431 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 30] Generated table #2496: 7123848 keys, 134944126 bytes
- 2018/07/27-04:57:07.774293 741ff390 EVENT_LOG_v1 {"time_micros": 1532667427774164, "cf_name": "default", "job": 30, "event": "table_file_creation", "file_number": 2496, "file_size": 134944126, "table_properties": {"data_size": 134218447, "index_size": 1089324, "filter_size": 0, "raw_key_size": 178096200, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37805, "num_entries": 7123848, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:57:42.500097 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 30] Generated table #2498: 7512737 keys, 134943578 bytes
- 2018/07/27-04:57:42.611933 741ff390 EVENT_LOG_v1 {"time_micros": 1532667462611757, "cf_name": "default", "job": 30, "event": "table_file_creation", "file_number": 2498, "file_size": 134943578, "table_properties": {"data_size": 134220219, "index_size": 1137594, "filter_size": 0, "raw_key_size": 187818425, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 38493, "num_entries": 7512737, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:58:17.748941 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2500. Immutable memtables: 1.
- 2018/07/27-04:58:18.005917 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 20 level-0 files rate 10737417
- 2018/07/27-04:58:18.006054 739fe390 [rocksdb/db/db_impl_compaction_flush.cc:80] [JOB 32] Syncing log #2497
- 2018/07/27-04:58:18.524764 739fe390 (Original Log Time 2018/07/27-04:58:18.006020) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-04:58:18.524805 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 32] Flushing memtable with next log file: 2497
- 2018/07/27-04:58:18.524825 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 32] Flushing memtable with next log file: 2500
- 2018/07/27-04:58:18.525654 739fe390 EVENT_LOG_v1 {"time_micros": 1532667498525589, "job": 32, "event": "flush_started", "num_memtables": 2, "num_entries": 3820795, "num_deletes": 0, "memory_usage": 153164484, "flush_reason": "Write Buffer Full"}
- 2018/07/27-04:58:18.525703 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 32] Level-0 flush table #2501: started
- 2018/07/27-04:58:18.532565 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 30] Generated table #2499: 7347863 keys, 134942303 bytes
- 2018/07/27-04:58:18.532694 741ff390 EVENT_LOG_v1 {"time_micros": 1532667498532621, "cf_name": "default", "job": 30, "event": "table_file_creation", "file_number": 2499, "file_size": 134942303, "table_properties": {"data_size": 134218849, "index_size": 1116620, "filter_size": 0, "raw_key_size": 183696575, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 38137, "num_entries": 7347863, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:58:37.669424 739fe390 EVENT_LOG_v1 {"time_micros": 1532667517669298, "cf_name": "default", "job": 32, "event": "table_file_creation", "file_number": 2501, "file_size": 95682390, "table_properties": {"data_size": 95211634, "index_size": 696254, "filter_size": 0, "raw_key_size": 109084208, "raw_average_key_size": 28, "raw_value_size": 2728040, "raw_average_value_size": 0, "num_data_blocks": 26301, "num_entries": 3812444, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:58:37.818005 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 32] Level-0 flush table #2501: 95682390 bytes OK
- 2018/07/27-04:58:37.840932 739fe390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 21 level-0 files rate 8589933
- 2018/07/27-04:58:37.864281 739fe390 (Original Log Time 2018/07/27-04:58:37.818845) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2501 started
- 2018/07/27-04:58:37.864305 739fe390 (Original Log Time 2018/07/27-04:58:37.840804) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2501: memtable #1 done
- 2018/07/27-04:58:37.864314 739fe390 (Original Log Time 2018/07/27-04:58:37.840818) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2501: memtable #2 done
- 2018/07/27-04:58:37.864323 739fe390 (Original Log Time 2018/07/27-04:58:37.840904) EVENT_LOG_v1 {"time_micros": 1532667517840859, "job": 32, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [21, 27, 129, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-04:58:37.864331 739fe390 (Original Log Time 2018/07/27-04:58:37.841018) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[21 27 129 23 0 0 0] max score 12.10
- 2018/07/27-04:58:37.864528 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 32] Try to delete WAL files size 92923480, prev total WAL file size 116621422, number of live WAL files 3.
- 2018/07/27-04:58:59.271020 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 30] Generated table #2502: 7206009 keys, 134946088 bytes
- 2018/07/27-04:58:59.271575 741ff390 EVENT_LOG_v1 {"time_micros": 1532667539271384, "cf_name": "default", "job": 30, "event": "table_file_creation", "file_number": 2502, "file_size": 134946088, "table_properties": {"data_size": 134221083, "index_size": 1099863, "filter_size": 0, "raw_key_size": 180150225, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37926, "num_entries": 7206009, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:59:12.793655 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 30] Generated table #2503: 3075533 keys, 58331032 bytes
- 2018/07/27-04:59:12.793886 741ff390 EVENT_LOG_v1 {"time_micros": 1532667552793811, "cf_name": "default", "job": 30, "event": "table_file_creation", "file_number": 2503, "file_size": 58331032, "table_properties": {"data_size": 58016819, "index_size": 469827, "filter_size": 0, "raw_key_size": 76888325, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 16338, "num_entries": 3075533, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-04:59:12.810067 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 30] Compacted 1@1 + 6@2 files to L2 => 867997265 bytes
- 2018/07/27-04:59:12.833581 741ff390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 21 level-0 files rate 10737416
- 2018/07/27-04:59:12.857020 741ff390 (Original Log Time 2018/07/27-04:59:12.833442) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[21 26 130 23 0 0 0] max score 12.10, MB/sec: 3.8 rd, 3.7 wr, level 2, files in(1, 6) out(7) MB in(128.7, 710.6) out(827.8), read-write-amplify(13.0) write-amplify(6.4) OK, records in: 24908594, records dropped: 0 output_compression: Snappy
- 2018/07/27-04:59:12.857058 741ff390 (Original Log Time 2018/07/27-04:59:12.833558) EVENT_LOG_v1 {"time_micros": 1532667552833495, "job": 30, "event": "compaction_finished", "compaction_time_micros": 232318304, "output_level": 2, "num_output_files": 7, "total_output_size": 867997265, "num_input_records": 46854163, "num_output_records": 46854163, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [21, 26, 130, 23, 0, 0, 0]}
- 2018/07/27-04:59:12.874361 741ff390 EVENT_LOG_v1 {"time_micros": 1532667552874332, "job": 30, "event": "table_file_deletion", "file_number": 2491}
- 2018/07/27-04:59:12.915621 741ff390 EVENT_LOG_v1 {"time_micros": 1532667552915594, "job": 30, "event": "table_file_deletion", "file_number": 2490}
- 2018/07/27-04:59:13.037831 741ff390 EVENT_LOG_v1 {"time_micros": 1532667553037803, "job": 30, "event": "table_file_deletion", "file_number": 2453}
- 2018/07/27-04:59:13.075554 741ff390 EVENT_LOG_v1 {"time_micros": 1532667553075525, "job": 30, "event": "table_file_deletion", "file_number": 2313}
- 2018/07/27-04:59:13.101713 741ff390 EVENT_LOG_v1 {"time_micros": 1532667553101672, "job": 30, "event": "table_file_deletion", "file_number": 2248}
- 2018/07/27-04:59:13.156727 741ff390 EVENT_LOG_v1 {"time_micros": 1532667553156700, "job": 30, "event": "table_file_deletion", "file_number": 1966}
- 2018/07/27-04:59:13.168314 741ff390 EVENT_LOG_v1 {"time_micros": 1532667553168284, "job": 30, "event": "table_file_deletion", "file_number": 1965}
- 2018/07/27-04:59:13.168694 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 33] Compacting 1@1 + 8@2 files to L2, score 12.10
- 2018/07/27-04:59:13.168740 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 32 Base level 1, inputs: [2321(128MB)], [2482(121MB) 2256(128MB) 2258(128MB) 2259(128MB) 2260(128MB) 2262(128MB) 2264(128MB) 2265(128MB)]
- 2018/07/27-04:59:13.177907 741ff390 EVENT_LOG_v1 {"time_micros": 1532667553168762, "job": 33, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2321], "files_L2": [2482, 2256, 2258, 2259, 2260, 2262, 2264, 2265], "score": 12.0988, "input_data_size": 1206600279}
- 2018/07/27-04:59:21.675518 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2505. Immutable memtables: 0.
- 2018/07/27-04:59:21.675608 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 21 level-0 files rate 8589932
- 2018/07/27-04:59:48.169902 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 33] Generated table #2504: 7141107 keys, 134945286 bytes
- 2018/07/27-04:59:48.170312 741ff390 EVENT_LOG_v1 {"time_micros": 1532667588170181, "cf_name": "default", "job": 33, "event": "table_file_creation", "file_number": 2504, "file_size": 134945286, "table_properties": {"data_size": 134218553, "index_size": 1092763, "filter_size": 0, "raw_key_size": 178527675, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37849, "num_entries": 7141107, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:00:22.938341 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 33] Generated table #2506: 7202994 keys, 134946937 bytes
- 2018/07/27-05:00:22.961586 741ff390 EVENT_LOG_v1 {"time_micros": 1532667622961488, "cf_name": "default", "job": 33, "event": "table_file_creation", "file_number": 2506, "file_size": 134946937, "table_properties": {"data_size": 134218780, "index_size": 1100446, "filter_size": 0, "raw_key_size": 180074850, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37969, "num_entries": 7202994, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:00:58.937622 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 33] Generated table #2507: 7157579 keys, 134947137 bytes
- 2018/07/27-05:00:58.961630 741ff390 EVENT_LOG_v1 {"time_micros": 1532667658961502, "cf_name": "default", "job": 33, "event": "table_file_creation", "file_number": 2507, "file_size": 134947137, "table_properties": {"data_size": 134219206, "index_size": 1094573, "filter_size": 0, "raw_key_size": 178939475, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37899, "num_entries": 7157579, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:00:59.631895 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2509. Immutable memtables: 1.
- 2018/07/27-05:00:59.631954 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 21 level-0 files rate 6871945
- 2018/07/27-05:00:59.632090 739fe390 [rocksdb/db/db_impl_compaction_flush.cc:80] [JOB 34] Syncing log #2505
- 2018/07/27-05:00:59.636918 739fe390 (Original Log Time 2018/07/27-05:00:59.632062) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-05:00:59.636947 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 34] Flushing memtable with next log file: 2505
- 2018/07/27-05:00:59.636963 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 34] Flushing memtable with next log file: 2509
- 2018/07/27-05:00:59.637048 739fe390 EVENT_LOG_v1 {"time_micros": 1532667659637011, "job": 34, "event": "flush_started", "num_memtables": 2, "num_entries": 4049286, "num_deletes": 0, "memory_usage": 162418736, "flush_reason": "Write Buffer Full"}
- 2018/07/27-05:00:59.637068 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 34] Level-0 flush table #2510: started
- 2018/07/27-05:01:17.266015 739fe390 EVENT_LOG_v1 {"time_micros": 1532667677265728, "cf_name": "default", "job": 34, "event": "table_file_creation", "file_number": 2510, "file_size": 99929711, "table_properties": {"data_size": 99430746, "index_size": 735029, "filter_size": 0, "raw_key_size": 115228792, "raw_average_key_size": 28, "raw_value_size": 2756188, "raw_average_value_size": 0, "num_data_blocks": 27655, "num_entries": 4042482, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:01:17.326744 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 34] Level-0 flush table #2510: 99929711 bytes OK
- 2018/07/27-05:01:17.350447 739fe390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 22 level-0 files rate 5497556
- 2018/07/27-05:01:17.350683 739fe390 (Original Log Time 2018/07/27-05:01:17.327930) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2510 started
- 2018/07/27-05:01:17.350708 739fe390 (Original Log Time 2018/07/27-05:01:17.350223) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2510: memtable #1 done
- 2018/07/27-05:01:17.350728 739fe390 (Original Log Time 2018/07/27-05:01:17.350246) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2510: memtable #2 done
- 2018/07/27-05:01:17.350747 739fe390 (Original Log Time 2018/07/27-05:01:17.350404) EVENT_LOG_v1 {"time_micros": 1532667677350313, "job": 34, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [22, 26, 130, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-05:01:17.350767 739fe390 (Original Log Time 2018/07/27-05:01:17.350553) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[22 26 130 23 0 0 0] max score 11.60
- 2018/07/27-05:01:17.351168 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 34] Try to delete WAL files size 97916694, prev total WAL file size 120167842, number of live WAL files 3.
- 2018/07/27-05:01:37.425160 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 33] Generated table #2508: 7175654 keys, 134944352 bytes
- 2018/07/27-05:01:37.425551 741ff390 EVENT_LOG_v1 {"time_micros": 1532667697425402, "cf_name": "default", "job": 33, "event": "table_file_creation", "file_number": 2508, "file_size": 134944352, "table_properties": {"data_size": 134218308, "index_size": 1096057, "filter_size": 0, "raw_key_size": 179391350, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37881, "num_entries": 7175654, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:02:09.162899 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 33] Generated table #2511: 7190389 keys, 134945530 bytes
- 2018/07/27-05:02:09.189862 741ff390 EVENT_LOG_v1 {"time_micros": 1532667729189778, "cf_name": "default", "job": 33, "event": "table_file_creation", "file_number": 2511, "file_size": 134945530, "table_properties": {"data_size": 134220327, "index_size": 1098373, "filter_size": 0, "raw_key_size": 179759725, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 37886, "num_entries": 7190389, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:02:22.685825 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2513. Immutable memtables: 0.
- 2018/07/27-05:02:22.686367 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 22 level-0 files rate 4398044
- 2018/07/27-05:02:46.092848 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 33] Generated table #2512: 7692661 keys, 134952130 bytes
- 2018/07/27-05:02:46.093377 741ff390 EVENT_LOG_v1 {"time_micros": 1532667766093216, "cf_name": "default", "job": 33, "event": "table_file_creation", "file_number": 2512, "file_size": 134952130, "table_properties": {"data_size": 134219770, "index_size": 1162606, "filter_size": 0, "raw_key_size": 192316525, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 39070, "num_entries": 7692661, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:03:20.271817 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 33] Generated table #2514: 8736033 keys, 135110626 bytes
- 2018/07/27-05:03:20.315010 741ff390 EVENT_LOG_v1 {"time_micros": 1532667800314912, "cf_name": "default", "job": 33, "event": "table_file_creation", "file_number": 2514, "file_size": 135110626, "table_properties": {"data_size": 134219230, "index_size": 1334173, "filter_size": 0, "raw_key_size": 218400825, "raw_average_key_size": 25, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 46075, "num_entries": 8736033, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:03:28.092987 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2516. Immutable memtables: 1.
- 2018/07/27-05:03:28.093087 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 22 level-0 files rate 3518435
- 2018/07/27-05:03:28.253455 739fe390 [rocksdb/db/db_impl_compaction_flush.cc:80] [JOB 35] Syncing log #2513
- 2018/07/27-05:03:28.308855 739fe390 (Original Log Time 2018/07/27-05:03:28.093189) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-05:03:28.308885 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 35] Flushing memtable with next log file: 2513
- 2018/07/27-05:03:28.308906 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 35] Flushing memtable with next log file: 2516
- 2018/07/27-05:03:28.309000 739fe390 EVENT_LOG_v1 {"time_micros": 1532667808308960, "job": 35, "event": "flush_started", "num_memtables": 2, "num_entries": 3754467, "num_deletes": 0, "memory_usage": 152326944, "flush_reason": "Write Buffer Full"}
- 2018/07/27-05:03:28.309019 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 35] Level-0 flush table #2517: started
- 2018/07/27-05:03:44.612178 739fe390 EVENT_LOG_v1 {"time_micros": 1532667824612016, "cf_name": "default", "job": 35, "event": "table_file_creation", "file_number": 2517, "file_size": 94373132, "table_properties": {"data_size": 93910229, "index_size": 684323, "filter_size": 0, "raw_key_size": 107281988, "raw_average_key_size": 28, "raw_value_size": 2680856, "raw_average_value_size": 0, "num_data_blocks": 25908, "num_entries": 3748190, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:03:44.635967 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 35] Level-0 flush table #2517: 94373132 bytes OK
- 2018/07/27-05:03:44.740407 739fe390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 23 level-0 files rate 2814748
- 2018/07/27-05:03:44.740691 739fe390 (Original Log Time 2018/07/27-05:03:44.694869) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2517 started
- 2018/07/27-05:03:44.740707 739fe390 (Original Log Time 2018/07/27-05:03:44.740192) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2517: memtable #1 done
- 2018/07/27-05:03:44.740716 739fe390 (Original Log Time 2018/07/27-05:03:44.740221) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2517: memtable #2 done
- 2018/07/27-05:03:44.740725 739fe390 (Original Log Time 2018/07/27-05:03:44.740368) EVENT_LOG_v1 {"time_micros": 1532667824740294, "job": 35, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [23, 26, 130, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-05:03:44.740735 739fe390 (Original Log Time 2018/07/27-05:03:44.740576) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[23 26 130 23 0 0 0] max score 11.60
- 2018/07/27-05:03:44.741028 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 35] Try to delete WAL files size 91353866, prev total WAL file size 113514464, number of live WAL files 3.
- 2018/07/27-05:03:56.351299 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 33] Generated table #2515: 6461155 keys, 134975418 bytes
- 2018/07/27-05:03:56.351529 741ff390 EVENT_LOG_v1 {"time_micros": 1532667836351450, "cf_name": "default", "job": 33, "event": "table_file_creation", "file_number": 2515, "file_size": 134975418, "table_properties": {"data_size": 134217797, "index_size": 1170399, "filter_size": 0, "raw_key_size": 183993067, "raw_average_key_size": 28, "raw_value_size": 5616048, "raw_average_value_size": 0, "num_data_blocks": 41959, "num_entries": 6461155, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:04:17.202444 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 33] Generated table #2518: 3056666 keys, 119792803 bytes
- 2018/07/27-05:04:17.347583 741ff390 EVENT_LOG_v1 {"time_micros": 1532667857347488, "cf_name": "default", "job": 33, "event": "table_file_creation", "file_number": 2518, "file_size": 119792803, "table_properties": {"data_size": 119249943, "index_size": 868648, "filter_size": 0, "raw_key_size": 125323306, "raw_average_key_size": 41, "raw_value_size": 12226664, "raw_average_value_size": 4, "num_data_blocks": 33590, "num_entries": 3056666, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:04:17.363182 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 33] Compacted 1@1 + 8@2 files to L2 => 1199560219 bytes
- 2018/07/27-05:04:17.403832 741ff390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 23 level-0 files rate 3518435
- 2018/07/27-05:04:17.404164 741ff390 (Original Log Time 2018/07/27-05:04:17.403651) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[23 25 131 23 0 0 0] max score 11.60, MB/sec: 4.0 rd, 3.9 wr, level 2, files in(1, 8) out(9) MB in(128.7, 1022.0) out(1144.0), read-write-amplify(17.8) write-amplify(8.9) OK, records in: 13132298, records dropped: 0 output_compression: Snappy
- 2018/07/27-05:04:17.404209 741ff390 (Original Log Time 2018/07/27-05:04:17.403804) EVENT_LOG_v1 {"time_micros": 1532667857403726, "job": 33, "event": "compaction_finished", "compaction_time_micros": 304184848, "output_level": 2, "num_output_files": 9, "total_output_size": 1199560219, "num_input_records": 61814238, "num_output_records": 61814238, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [23, 25, 131, 23, 0, 0, 0]}
- 2018/07/27-05:04:17.449234 741ff390 EVENT_LOG_v1 {"time_micros": 1532667857449203, "job": 33, "event": "table_file_deletion", "file_number": 2482}
- 2018/07/27-05:04:17.532787 741ff390 EVENT_LOG_v1 {"time_micros": 1532667857532754, "job": 33, "event": "table_file_deletion", "file_number": 2321}
- 2018/07/27-05:04:17.619261 741ff390 EVENT_LOG_v1 {"time_micros": 1532667857619234, "job": 33, "event": "table_file_deletion", "file_number": 2265}
- 2018/07/27-05:04:17.631794 741ff390 EVENT_LOG_v1 {"time_micros": 1532667857631766, "job": 33, "event": "table_file_deletion", "file_number": 2264}
- 2018/07/27-05:04:17.644793 741ff390 EVENT_LOG_v1 {"time_micros": 1532667857644745, "job": 33, "event": "table_file_deletion", "file_number": 2262}
- 2018/07/27-05:04:17.657267 741ff390 EVENT_LOG_v1 {"time_micros": 1532667857657233, "job": 33, "event": "table_file_deletion", "file_number": 2260}
- 2018/07/27-05:04:17.666037 741ff390 EVENT_LOG_v1 {"time_micros": 1532667857666010, "job": 33, "event": "table_file_deletion", "file_number": 2259}
- 2018/07/27-05:04:17.666638 741ff390 EVENT_LOG_v1 {"time_micros": 1532667857666620, "job": 33, "event": "table_file_deletion", "file_number": 2258}
- 2018/07/27-05:04:17.667468 741ff390 EVENT_LOG_v1 {"time_micros": 1532667857667450, "job": 33, "event": "table_file_deletion", "file_number": 2256}
- 2018/07/27-05:04:17.668796 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 36] Compacting 1@1 + 4@2 files to L2, score 11.60
- 2018/07/27-05:04:17.668888 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 35 Base level 1, inputs: [2329(128MB)], [2008(128MB) 2009(128MB) 2010(128MB) 2268(128MB)]
- 2018/07/27-05:04:17.683784 741ff390 EVENT_LOG_v1 {"time_micros": 1532667857668914, "job": 36, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2329], "files_L2": [2008, 2009, 2010, 2268], "score": 11.5962, "input_data_size": 674074270}
- 2018/07/27-05:04:41.795892 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2520. Immutable memtables: 0.
- 2018/07/27-05:04:41.795986 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 23 level-0 files rate 2814748
- 2018/07/27-05:04:44.308891 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 36] Generated table #2519: 3540910 keys, 134833535 bytes
- 2018/07/27-05:04:44.309030 741ff390 EVENT_LOG_v1 {"time_micros": 1532667884308952, "cf_name": "default", "job": 36, "event": "table_file_creation", "file_number": 2519, "file_size": 134833535, "table_properties": {"data_size": 134218093, "index_size": 1003321, "filter_size": 0, "raw_key_size": 145177310, "raw_average_key_size": 41, "raw_value_size": 14163640, "raw_average_value_size": 4, "num_data_blocks": 38918, "num_entries": 3540910, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:05:09.632931 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 36] Generated table #2521: 3548182 keys, 134830018 bytes
- 2018/07/27-05:05:09.661852 741ff390 EVENT_LOG_v1 {"time_micros": 1532667909661675, "cf_name": "default", "job": 36, "event": "table_file_creation", "file_number": 2521, "file_size": 134830018, "table_properties": {"data_size": 134220144, "index_size": 1008992, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:05:37.350986 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 36] Generated table #2522: 3548182 keys, 134829757 bytes
- 2018/07/27-05:05:37.456644 741ff390 EVENT_LOG_v1 {"time_micros": 1532667937456543, "cf_name": "default", "job": 36, "event": "table_file_creation", "file_number": 2522, "file_size": 134829757, "table_properties": {"data_size": 134220357, "index_size": 1009143, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:05:42.159346 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2524. Immutable memtables: 1.
- 2018/07/27-05:05:42.159404 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 23 level-0 files rate 2251798
- 2018/07/27-05:05:42.159552 739fe390 [rocksdb/db/db_impl_compaction_flush.cc:80] [JOB 37] Syncing log #2520
- 2018/07/27-05:05:42.192959 739fe390 (Original Log Time 2018/07/27-05:05:42.159525) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-05:05:42.192989 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 37] Flushing memtable with next log file: 2520
- 2018/07/27-05:05:42.193008 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 37] Flushing memtable with next log file: 2524
- 2018/07/27-05:05:42.193106 739fe390 EVENT_LOG_v1 {"time_micros": 1532667942193067, "job": 37, "event": "flush_started", "num_memtables": 2, "num_entries": 3417163, "num_deletes": 0, "memory_usage": 135687332, "flush_reason": "Write Buffer Full"}
- 2018/07/27-05:05:42.193127 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 37] Level-0 flush table #2525: started
- 2018/07/27-05:05:55.898498 739fe390 EVENT_LOG_v1 {"time_micros": 1532667955898403, "cf_name": "default", "job": 37, "event": "table_file_creation", "file_number": 2525, "file_size": 85242189, "table_properties": {"data_size": 84820291, "index_size": 621041, "filter_size": 0, "raw_key_size": 97481420, "raw_average_key_size": 28, "raw_value_size": 2372448, "raw_average_value_size": 0, "num_data_blocks": 23522, "num_entries": 3413374, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:05:55.920396 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 37] Level-0 flush table #2525: 85242189 bytes OK
- 2018/07/27-05:05:55.955629 739fe390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 24 level-0 files rate 1801438
- 2018/07/27-05:05:55.955745 739fe390 (Original Log Time 2018/07/27-05:05:55.927496) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2525 started
- 2018/07/27-05:05:55.955756 739fe390 (Original Log Time 2018/07/27-05:05:55.955508) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2525: memtable #1 done
- 2018/07/27-05:05:55.955765 739fe390 (Original Log Time 2018/07/27-05:05:55.955523) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2525: memtable #2 done
- 2018/07/27-05:05:55.955773 739fe390 (Original Log Time 2018/07/27-05:05:55.955610) EVENT_LOG_v1 {"time_micros": 1532667955955561, "job": 37, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [24, 25, 131, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-05:05:55.955782 739fe390 (Original Log Time 2018/07/27-05:05:55.955684) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[24 25 131 23 0 0 0] max score 11.09
- 2018/07/27-05:05:55.956012 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 37] Try to delete WAL files size 82869210, prev total WAL file size 98401554, number of live WAL files 3.
- 2018/07/27-05:06:05.628773 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 36] Generated table #2523: 3548182 keys, 134829300 bytes
- 2018/07/27-05:06:05.628995 741ff390 EVENT_LOG_v1 {"time_micros": 1532667965628920, "cf_name": "default", "job": 36, "event": "table_file_creation", "file_number": 2523, "file_size": 134829300, "table_properties": {"data_size": 134219996, "index_size": 1009160, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:06:25.102522 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 36] Generated table #2526: 2970846 keys, 112925703 bytes
- 2018/07/27-05:06:25.102833 741ff390 EVENT_LOG_v1 {"time_micros": 1532667985102748, "cf_name": "default", "job": 36, "event": "table_file_creation", "file_number": 2526, "file_size": 112925703, "table_properties": {"data_size": 112414265, "index_size": 844430, "filter_size": 0, "raw_key_size": 121804686, "raw_average_key_size": 41, "raw_value_size": 11883384, "raw_average_value_size": 4, "num_data_blocks": 32647, "num_entries": 2970846, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:06:25.226786 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 36] Compacted 1@1 + 4@2 files to L2 => 652248313 bytes
- 2018/07/27-05:06:25.245343 741ff390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 24 level-0 files rate 2251797
- 2018/07/27-05:06:25.245487 741ff390 (Original Log Time 2018/07/27-05:06:25.245208) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[24 24 132 23 0 0 0] max score 11.09, MB/sec: 5.3 rd, 5.1 wr, level 2, files in(1, 4) out(5) MB in(128.5, 514.3) out(622.0), read-write-amplify(9.8) write-amplify(4.8) OK, records in: 0, records dropped: 0 output_compression: Snappy
- 2018/07/27-05:06:25.245514 741ff390 (Original Log Time 2018/07/27-05:06:25.245324) EVENT_LOG_v1 {"time_micros": 1532667985245262, "job": 36, "event": "compaction_finished", "compaction_time_micros": 127542828, "output_level": 2, "num_output_files": 5, "total_output_size": 652248313, "num_input_records": 17156302, "num_output_records": 17156302, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [24, 24, 132, 23, 0, 0, 0]}
- 2018/07/27-05:06:25.319772 741ff390 EVENT_LOG_v1 {"time_micros": 1532667985319738, "job": 36, "event": "table_file_deletion", "file_number": 2329}
- 2018/07/27-05:06:25.393907 741ff390 EVENT_LOG_v1 {"time_micros": 1532667985393872, "job": 36, "event": "table_file_deletion", "file_number": 2268}
- 2018/07/27-05:06:25.420945 741ff390 EVENT_LOG_v1 {"time_micros": 1532667985420912, "job": 36, "event": "table_file_deletion", "file_number": 2010}
- 2018/07/27-05:06:25.434790 741ff390 EVENT_LOG_v1 {"time_micros": 1532667985434751, "job": 36, "event": "table_file_deletion", "file_number": 2009}
- 2018/07/27-05:06:25.448367 741ff390 EVENT_LOG_v1 {"time_micros": 1532667985448333, "job": 36, "event": "table_file_deletion", "file_number": 2008}
- 2018/07/27-05:06:25.462162 741ff390 [WARN] [rocksdb/db/db_impl.cc:491] ------- DUMPING STATS -------
- 2018/07/27-05:06:25.462327 741ff390 [WARN] [rocksdb/db/db_impl.cc:492]
- ** DB Stats **
- Uptime(secs): 3666.8 total, 665.0 interval
- Cumulative writes: 86 writes, 76M keys, 86 commit groups, 1.0 writes per commit group, ingest: 1.72 GB, 0.48 MB/s
- Cumulative WAL: 86 writes, 86 syncs, 0.99 writes per sync, written: 1.72 GB, 0.48 MB/s
- Cumulative stall: 00:00:52.811 H:M:S, 1.4 percent
- Interval writes: 18 writes, 15M keys, 18 commit groups, 0.9 writes per commit group, ingest: 362.96 MB, 0.55 MB/s
- Interval WAL: 18 writes, 18 syncs, 0.95 writes per sync, written: 0.35 MB, 0.55 MB/s
- Interval stall: 00:00:52.811 H:M:S, 7.9 percent
- ** Compaction Stats [default] **
- Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- ----------------------------------------------------------------------------------------------------------------------------------------------------------
- L0 24/0 1.92 GB 7.7 0.0 0.0 0.0 1.7 1.7 0.0 1.0 0.0 5.8 305 21 14.528 0 0
- L1 24/0 2.77 GB 11.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L2 132/0 15.94 GB 6.4 13.7 1.9 11.8 13.6 1.7 0.0 7.2 3.8 3.8 3661 15 244.093 162M 2
- L3 23/0 2.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Sum 203/0 23.18 GB 0.0 13.7 1.9 11.8 15.3 3.5 0.0 8.8 3.5 4.0 3966 36 110.180 162M 2
- Int 0/0 0.00 KB 0.0 2.6 0.4 2.2 3.0 0.8 0.0 6.7 3.5 4.1 746 8 93.265 38M 0
- Uptime(secs): 3666.8 total, 665.0 interval
- Flush(GB): cumulative 1.741, interval 0.442
- AddFile(GB): cumulative 0.000, interval 0.000
- AddFile(Total Files): cumulative 0, interval 0
- AddFile(L0 Files): cumulative 0, interval 0
- AddFile(Keys): cumulative 0, interval 0
- Cumulative compaction: 15.31 GB write, 4.27 MB/s write, 13.71 GB read, 3.83 MB/s read, 3966.5 seconds
- Interval compaction: 2.97 GB write, 4.58 MB/s write, 2.57 GB read, 3.96 MB/s read, 746.1 seconds
- Stalls(count): 16 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 16 total count
- ** File Read Latency Histogram By Level [default] **
- ** Compaction Stats [default] **
- Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
- ----------------------------------------------------------------------------------------------------------------------------------------------------------
- L0 24/0 1.92 GB 7.7 0.0 0.0 0.0 1.7 1.7 0.0 1.0 0.0 5.8 305 21 14.528 0 0
- L1 24/0 2.77 GB 11.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- L2 132/0 15.94 GB 6.4 13.7 1.9 11.8 13.6 1.7 0.0 7.2 3.8 3.8 3661 15 244.093 162M 2
- L3 23/0 2.55 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Sum 203/0 23.18 GB 0.0 13.7 1.9 11.8 15.3 3.5 0.0 8.8 3.5 4.0 3966 36 110.180 162M 2
- Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
- Uptime(secs): 3666.8 total, 0.0 interval
- Flush(GB): cumulative 1.741, interval 0.000
- AddFile(GB): cumulative 0.000, interval 0.000
- AddFile(Total Files): cumulative 0, interval 0
- AddFile(L0 Files): cumulative 0, interval 0
- AddFile(Keys): cumulative 0, interval 0
- Cumulative compaction: 15.31 GB write, 4.27 MB/s write, 13.71 GB read, 3.83 MB/s read, 3966.5 seconds
- Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
- Stalls(count): 16 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
- ** File Read Latency Histogram By Level [default] **
- 2018/07/27-05:06:25.462803 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 38] Compacting 1@1 + 7@2 files to L2, score 11.09
- 2018/07/27-05:06:25.462859 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 37 Base level 1, inputs: [2330(128MB)], [2526(107MB) 2269(128MB) 2272(128MB) 2273(128MB) 2274(128MB) 2275(128MB) 2277(128MB)]
- 2018/07/27-05:06:25.462991 741ff390 EVENT_LOG_v1 {"time_micros": 1532667985462907, "job": 38, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2330], "files_L2": [2526, 2269, 2272, 2273, 2274, 2275, 2277], "score": 11.0942, "input_data_size": 1056654983}
- 2018/07/27-05:06:43.373910 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 38] Generated table #2527: 3548182 keys, 134830090 bytes
- 2018/07/27-05:06:43.386182 741ff390 EVENT_LOG_v1 {"time_micros": 1532668003386092, "cf_name": "default", "job": 38, "event": "table_file_creation", "file_number": 2527, "file_size": 134830090, "table_properties": {"data_size": 134220639, "index_size": 1008995, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:07:01.032592 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2529. Immutable memtables: 0.
- 2018/07/27-05:07:01.032776 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 24 level-0 files rate 1801437
- 2018/07/27-05:07:07.563580 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 38] Generated table #2528: 3548182 keys, 134828143 bytes
- 2018/07/27-05:07:07.672695 741ff390 EVENT_LOG_v1 {"time_micros": 1532668027672601, "cf_name": "default", "job": 38, "event": "table_file_creation", "file_number": 2528, "file_size": 134828143, "table_properties": {"data_size": 134218240, "index_size": 1009022, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:07:33.130345 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 38] Generated table #2530: 3548091 keys, 134829404 bytes
- 2018/07/27-05:07:33.177519 741ff390 EVENT_LOG_v1 {"time_micros": 1532668053177248, "cf_name": "default", "job": 38, "event": "table_file_creation", "file_number": 2530, "file_size": 134829404, "table_properties": {"data_size": 134219826, "index_size": 1009084, "filter_size": 0, "raw_key_size": 145471731, "raw_average_key_size": 41, "raw_value_size": 14192364, "raw_average_value_size": 4, "num_data_blocks": 38991, "num_entries": 3548091, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:08:03.892188 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 38] Generated table #2531: 3548182 keys, 134829193 bytes
- 2018/07/27-05:08:04.060847 741ff390 EVENT_LOG_v1 {"time_micros": 1532668084060740, "cf_name": "default", "job": 38, "event": "table_file_creation", "file_number": 2531, "file_size": 134829193, "table_properties": {"data_size": 134219640, "index_size": 1009188, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:08:22.761274 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2533. Immutable memtables: 1.
- 2018/07/27-05:08:22.975494 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 24 level-0 files rate 1441149
- 2018/07/27-05:08:23.181314 739fe390 [rocksdb/db/db_impl_compaction_flush.cc:80] [JOB 39] Syncing log #2529
- 2018/07/27-05:08:23.211193 739fe390 (Original Log Time 2018/07/27-05:08:23.044115) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-05:08:23.211218 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 39] Flushing memtable with next log file: 2529
- 2018/07/27-05:08:23.211233 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 39] Flushing memtable with next log file: 2533
- 2018/07/27-05:08:23.211318 739fe390 EVENT_LOG_v1 {"time_micros": 1532668103211280, "job": 39, "event": "flush_started", "num_memtables": 2, "num_entries": 3530289, "num_deletes": 0, "memory_usage": 140191820, "flush_reason": "Write Buffer Full"}
- 2018/07/27-05:08:23.231784 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 39] Level-0 flush table #2534: started
- 2018/07/27-05:08:32.793793 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 38] Generated table #2532: 3548182 keys, 134830160 bytes
- 2018/07/27-05:08:32.867774 741ff390 EVENT_LOG_v1 {"time_micros": 1532668112867667, "cf_name": "default", "job": 38, "event": "table_file_creation", "file_number": 2532, "file_size": 134830160, "table_properties": {"data_size": 134220516, "index_size": 1009212, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:08:35.039927 739fe390 EVENT_LOG_v1 {"time_micros": 1532668115039831, "cf_name": "default", "job": 39, "event": "table_file_creation", "file_number": 2534, "file_size": 86760615, "table_properties": {"data_size": 86327906, "index_size": 635549, "filter_size": 0, "raw_key_size": 99719597, "raw_average_key_size": 28, "raw_value_size": 2344588, "raw_average_value_size": 0, "num_data_blocks": 23993, "num_entries": 3504117, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:08:35.040095 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 39] Level-0 flush table #2534: 86760615 bytes OK
- 2018/07/27-05:08:35.106404 739fe390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 25 level-0 files rate 1152919
- 2018/07/27-05:08:35.124260 739fe390 (Original Log Time 2018/07/27-05:08:35.041853) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2534 started
- 2018/07/27-05:08:35.124294 739fe390 (Original Log Time 2018/07/27-05:08:35.106280) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2534: memtable #1 done
- 2018/07/27-05:08:35.124303 739fe390 (Original Log Time 2018/07/27-05:08:35.106294) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2534: memtable #2 done
- 2018/07/27-05:08:35.124312 739fe390 (Original Log Time 2018/07/27-05:08:35.106375) EVENT_LOG_v1 {"time_micros": 1532668115106330, "job": 39, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [25, 24, 132, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-05:08:35.124321 739fe390 (Original Log Time 2018/07/27-05:08:35.106480) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[25 24 132 23 0 0 0] max score 10.59
- 2018/07/27-05:08:35.124674 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 39] Try to delete WAL files size 85073472, prev total WAL file size 85073472, number of live WAL files 3.
- 2018/07/27-05:08:59.217235 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 38] Generated table #2535: 3548182 keys, 134827299 bytes
- 2018/07/27-05:08:59.217464 741ff390 EVENT_LOG_v1 {"time_micros": 1532668139217387, "cf_name": "default", "job": 38, "event": "table_file_creation", "file_number": 2535, "file_size": 134827299, "table_properties": {"data_size": 134217848, "index_size": 1009061, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:09:22.199892 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 38] Generated table #2536: 3547636 keys, 134831019 bytes
- 2018/07/27-05:09:22.223158 741ff390 EVENT_LOG_v1 {"time_micros": 1532668162223068, "cf_name": "default", "job": 38, "event": "table_file_creation", "file_number": 2536, "file_size": 134831019, "table_properties": {"data_size": 134220642, "index_size": 1008789, "filter_size": 0, "raw_key_size": 145453076, "raw_average_key_size": 41, "raw_value_size": 14190544, "raw_average_value_size": 4, "num_data_blocks": 38986, "num_entries": 3547636, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:09:38.341963 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 38] Generated table #2537: 2381481 keys, 90546509 bytes
- 2018/07/27-05:09:38.342236 741ff390 EVENT_LOG_v1 {"time_micros": 1532668178342146, "cf_name": "default", "job": 38, "event": "table_file_creation", "file_number": 2537, "file_size": 90546509, "table_properties": {"data_size": 90135701, "index_size": 676626, "filter_size": 0, "raw_key_size": 97640721, "raw_average_key_size": 41, "raw_value_size": 9525924, "raw_average_value_size": 4, "num_data_blocks": 26171, "num_entries": 2381481, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:09:38.352669 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 38] Compacted 1@1 + 7@2 files to L2 => 1034351817 bytes
- 2018/07/27-05:09:38.369221 741ff390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 25 level-0 files rate 1441148
- 2018/07/27-05:09:38.384511 741ff390 (Original Log Time 2018/07/27-05:09:38.369075) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[25 23 133 23 0 0 0] max score 10.59, MB/sec: 5.5 rd, 5.4 wr, level 2, files in(1, 7) out(8) MB in(128.5, 879.2) out(986.4), read-write-amplify(15.5) write-amplify(7.7) OK, records in: 2970846, records dropped: 0 output_compression: Snappy
- 2018/07/27-05:09:38.384560 741ff390 (Original Log Time 2018/07/27-05:09:38.369198) EVENT_LOG_v1 {"time_micros": 1532668178369130, "job": 38, "event": "compaction_finished", "compaction_time_micros": 192880494, "output_level": 2, "num_output_files": 8, "total_output_size": 1034351817, "num_input_records": 27218118, "num_output_records": 27218118, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [25, 23, 133, 23, 0, 0, 0]}
- 2018/07/27-05:09:38.436244 741ff390 EVENT_LOG_v1 {"time_micros": 1532668178436212, "job": 38, "event": "table_file_deletion", "file_number": 2526}
- 2018/07/27-05:09:38.516370 741ff390 EVENT_LOG_v1 {"time_micros": 1532668178516333, "job": 38, "event": "table_file_deletion", "file_number": 2330}
- 2018/07/27-05:09:38.620092 741ff390 EVENT_LOG_v1 {"time_micros": 1532668178620066, "job": 38, "event": "table_file_deletion", "file_number": 2277}
- 2018/07/27-05:09:38.666741 741ff390 EVENT_LOG_v1 {"time_micros": 1532668178666713, "job": 38, "event": "table_file_deletion", "file_number": 2275}
- 2018/07/27-05:09:38.685617 741ff390 EVENT_LOG_v1 {"time_micros": 1532668178685585, "job": 38, "event": "table_file_deletion", "file_number": 2274}
- 2018/07/27-05:09:38.702568 741ff390 EVENT_LOG_v1 {"time_micros": 1532668178702537, "job": 38, "event": "table_file_deletion", "file_number": 2273}
- 2018/07/27-05:09:38.703550 741ff390 EVENT_LOG_v1 {"time_micros": 1532668178703525, "job": 38, "event": "table_file_deletion", "file_number": 2272}
- 2018/07/27-05:09:38.714944 741ff390 EVENT_LOG_v1 {"time_micros": 1532668178714916, "job": 38, "event": "table_file_deletion", "file_number": 2269}
- 2018/07/27-05:09:38.715242 741ff390 [rocksdb/db/compaction_picker.cc:485] [default] Expanding@1 1+5(134742469+593890949 bytes) to 3+5 (404196663+593890949 bytes)
- 2018/07/27-05:09:38.715378 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 40] Compacting 3@1 + 5@2 files to L2, score 10.59
- 2018/07/27-05:09:38.715417 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 39 Base level 1, inputs: [2322(128MB) 2323(128MB) 2324(128MB)], [2518(114MB) 2267(117MB) 1996(128MB) 1999(91MB) 1337(113MB)]
- 2018/07/27-05:09:38.730065 741ff390 EVENT_LOG_v1 {"time_micros": 1532668178715446, "job": 40, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2322, 2323, 2324], "files_L2": [2518, 2267, 1996, 1999, 1337], "score": 10.5923, "input_data_size": 998087612}
- 2018/07/27-05:09:40.107483 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2539. Immutable memtables: 0.
- 2018/07/27-05:09:40.107538 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 25 level-0 files rate 1152918
- 2018/07/27-05:10:02.823016 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 40] Generated table #2538: 3548182 keys, 134829287 bytes
- 2018/07/27-05:10:02.848711 741ff390 EVENT_LOG_v1 {"time_micros": 1532668202848600, "cf_name": "default", "job": 40, "event": "table_file_creation", "file_number": 2538, "file_size": 134829287, "table_properties": {"data_size": 134219580, "index_size": 1009081, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:10:29.258599 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 40] Generated table #2540: 3548182 keys, 134827775 bytes
- 2018/07/27-05:10:29.305191 741ff390 EVENT_LOG_v1 {"time_micros": 1532668229305075, "cf_name": "default", "job": 40, "event": "table_file_creation", "file_number": 2540, "file_size": 134827775, "table_properties": {"data_size": 134218079, "index_size": 1009080, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:10:56.775275 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 40] Generated table #2541: 3548273 keys, 134830823 bytes
- 2018/07/27-05:10:56.902243 741ff390 EVENT_LOG_v1 {"time_micros": 1532668256902039, "cf_name": "default", "job": 40, "event": "table_file_creation", "file_number": 2541, "file_size": 134830823, "table_properties": {"data_size": 134221003, "index_size": 1009075, "filter_size": 0, "raw_key_size": 145479193, "raw_average_key_size": 41, "raw_value_size": 14193092, "raw_average_value_size": 4, "num_data_blocks": 38993, "num_entries": 3548273, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:11:03.980027 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2543. Immutable memtables: 1.
- 2018/07/27-05:11:03.980187 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 25 level-0 files rate 922334
- 2018/07/27-05:11:04.164611 739fe390 [rocksdb/db/db_impl_compaction_flush.cc:80] [JOB 41] Syncing log #2539
- 2018/07/27-05:11:04.227280 739fe390 (Original Log Time 2018/07/27-05:11:03.980268) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-05:11:04.227307 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 41] Flushing memtable with next log file: 2539
- 2018/07/27-05:11:04.227323 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 41] Flushing memtable with next log file: 2543
- 2018/07/27-05:11:04.227408 739fe390 EVENT_LOG_v1 {"time_micros": 1532668264227370, "job": 41, "event": "flush_started", "num_memtables": 2, "num_entries": 3680950, "num_deletes": 0, "memory_usage": 149403764, "flush_reason": "Write Buffer Full"}
- 2018/07/27-05:11:04.227431 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 41] Level-0 flush table #2544: started
- 2018/07/27-05:11:18.510972 739fe390 EVENT_LOG_v1 {"time_micros": 1532668278510881, "cf_name": "default", "job": 41, "event": "table_file_creation", "file_number": 2544, "file_size": 91918111, "table_properties": {"data_size": 91463997, "index_size": 669899, "filter_size": 0, "raw_key_size": 105004650, "raw_average_key_size": 28, "raw_value_size": 2593104, "raw_average_value_size": 0, "num_data_blocks": 25317, "num_entries": 3671454, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:11:18.598233 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 41] Level-0 flush table #2544: 91918111 bytes OK
- 2018/07/27-05:11:18.615676 739fe390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 26 level-0 files rate 737867
- 2018/07/27-05:11:18.615802 739fe390 (Original Log Time 2018/07/27-05:11:18.599053) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2544 started
- 2018/07/27-05:11:18.615813 739fe390 (Original Log Time 2018/07/27-05:11:18.615558) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2544: memtable #1 done
- 2018/07/27-05:11:18.615822 739fe390 (Original Log Time 2018/07/27-05:11:18.615572) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2544: memtable #2 done
- 2018/07/27-05:11:18.615830 739fe390 (Original Log Time 2018/07/27-05:11:18.615655) EVENT_LOG_v1 {"time_micros": 1532668278615607, "job": 41, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [26, 23, 133, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-05:11:18.615839 739fe390 (Original Log Time 2018/07/27-05:11:18.615741) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[26 23 133 23 0 0 0] max score 9.09
- 2018/07/27-05:11:18.616071 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 41] Try to delete WAL files size 89436836, prev total WAL file size 89436836, number of live WAL files 3.
- 2018/07/27-05:11:26.495371 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 40] Generated table #2542: 3548182 keys, 134829552 bytes
- 2018/07/27-05:11:26.495589 741ff390 EVENT_LOG_v1 {"time_micros": 1532668286495513, "cf_name": "default", "job": 40, "event": "table_file_creation", "file_number": 2542, "file_size": 134829552, "table_properties": {"data_size": 134219976, "index_size": 1009052, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:11:52.759727 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 40] Generated table #2545: 3548182 keys, 134830388 bytes
- 2018/07/27-05:11:52.847950 741ff390 EVENT_LOG_v1 {"time_micros": 1532668312847862, "cf_name": "default", "job": 40, "event": "table_file_creation", "file_number": 2545, "file_size": 134830388, "table_properties": {"data_size": 134220395, "index_size": 1009101, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:12:18.024587 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 40] Generated table #2546: 3548182 keys, 134829477 bytes
- 2018/07/27-05:12:18.053769 741ff390 EVENT_LOG_v1 {"time_micros": 1532668338053660, "cf_name": "default", "job": 40, "event": "table_file_creation", "file_number": 2546, "file_size": 134829477, "table_properties": {"data_size": 134219948, "index_size": 1009291, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:12:39.182827 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 40] Generated table #2547: 3149941 keys, 119707607 bytes
- 2018/07/27-05:12:39.296481 741ff390 EVENT_LOG_v1 {"time_micros": 1532668359296396, "cf_name": "default", "job": 40, "event": "table_file_creation", "file_number": 2547, "file_size": 119707607, "table_properties": {"data_size": 119165854, "index_size": 895583, "filter_size": 0, "raw_key_size": 129147581, "raw_average_key_size": 41, "raw_value_size": 12599764, "raw_average_value_size": 4, "num_data_blocks": 34616, "num_entries": 3149941, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:12:39.318998 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 40] Compacted 3@1 + 5@2 files to L2 => 928684909 bytes
- 2018/07/27-05:12:39.336064 741ff390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 26 level-0 files rate 922333
- 2018/07/27-05:12:39.351667 741ff390 (Original Log Time 2018/07/27-05:12:39.335914) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[26 20 135 23 0 0 0] max score 9.09, MB/sec: 5.5 rd, 5.1 wr, level 2, files in(3, 5) out(7) MB in(385.5, 566.4) out(885.7), read-write-amplify(4.8) write-amplify(2.3) OK, records in: 3056666, records dropped: 0 output_compression: Snappy
- 2018/07/27-05:12:39.351710 741ff390 (Original Log Time 2018/07/27-05:12:39.336039) EVENT_LOG_v1 {"time_micros": 1532668359335975, "job": 40, "event": "compaction_finished", "compaction_time_micros": 180580304, "output_level": 2, "num_output_files": 7, "total_output_size": 928684909, "num_input_records": 24439124, "num_output_records": 24439124, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [26, 20, 135, 23, 0, 0, 0]}
- 2018/07/27-05:12:39.389569 741ff390 EVENT_LOG_v1 {"time_micros": 1532668359389541, "job": 40, "event": "table_file_deletion", "file_number": 2518}
- 2018/07/27-05:12:39.492545 741ff390 EVENT_LOG_v1 {"time_micros": 1532668359492518, "job": 40, "event": "table_file_deletion", "file_number": 2324}
- 2018/07/27-05:12:39.504847 741ff390 EVENT_LOG_v1 {"time_micros": 1532668359504818, "job": 40, "event": "table_file_deletion", "file_number": 2323}
- 2018/07/27-05:12:39.512769 741ff390 EVENT_LOG_v1 {"time_micros": 1532668359512741, "job": 40, "event": "table_file_deletion", "file_number": 2322}
- 2018/07/27-05:12:39.523937 741ff390 EVENT_LOG_v1 {"time_micros": 1532668359523911, "job": 40, "event": "table_file_deletion", "file_number": 2267}
- 2018/07/27-05:12:39.539121 741ff390 EVENT_LOG_v1 {"time_micros": 1532668359539094, "job": 40, "event": "table_file_deletion", "file_number": 1999}
- 2018/07/27-05:12:39.564186 741ff390 EVENT_LOG_v1 {"time_micros": 1532668359564159, "job": 40, "event": "table_file_deletion", "file_number": 1996}
- 2018/07/27-05:12:39.582246 741ff390 EVENT_LOG_v1 {"time_micros": 1532668359582218, "job": 40, "event": "table_file_deletion", "file_number": 1337}
- 2018/07/27-05:12:39.597017 741ff390 [rocksdb/db/compaction_picker.cc:485] [default] Expanding@1 1+3(134741153+360534419 bytes) to 2+3 (240853711+360534419 bytes)
- 2018/07/27-05:12:39.597195 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 42] Compacting 2@1 + 3@2 files to L2, score 9.09
- 2018/07/27-05:12:39.597227 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 41 Base level 1, inputs: [2326(128MB) 2327(101MB)], [1827(128MB) 1828(128MB) 1829(86MB)]
- 2018/07/27-05:12:39.617771 741ff390 EVENT_LOG_v1 {"time_micros": 1532668359597257, "job": 42, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [2326, 2327], "files_L2": [1827, 1828, 1829], "score": 9.08652, "input_data_size": 601388130}
- 2018/07/27-05:13:04.733317 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 42] Generated table #2548: 3547454 keys, 134830451 bytes
- 2018/07/27-05:13:04.756894 741ff390 EVENT_LOG_v1 {"time_micros": 1532668384756803, "cf_name": "default", "job": 42, "event": "table_file_creation", "file_number": 2548, "file_size": 134830451, "table_properties": {"data_size": 134219698, "index_size": 1008372, "filter_size": 0, "raw_key_size": 145445614, "raw_average_key_size": 41, "raw_value_size": 14189816, "raw_average_value_size": 4, "num_data_blocks": 38984, "num_entries": 3547454, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:13:07.478338 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2550. Immutable memtables: 0.
- 2018/07/27-05:13:07.478395 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 26 level-0 files rate 737866
- 2018/07/27-05:13:30.917394 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 42] Generated table #2549: 3548091 keys, 134827649 bytes
- 2018/07/27-05:13:30.941195 741ff390 EVENT_LOG_v1 {"time_micros": 1532668410941075, "cf_name": "default", "job": 42, "event": "table_file_creation", "file_number": 2549, "file_size": 134827649, "table_properties": {"data_size": 134217984, "index_size": 1009194, "filter_size": 0, "raw_key_size": 145471731, "raw_average_key_size": 41, "raw_value_size": 14192364, "raw_average_value_size": 4, "num_data_blocks": 38991, "num_entries": 3548091, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:13:57.763467 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 42] Generated table #2551: 3548182 keys, 134829106 bytes
- 2018/07/27-05:13:57.803298 741ff390 EVENT_LOG_v1 {"time_micros": 1532668437803170, "cf_name": "default", "job": 42, "event": "table_file_creation", "file_number": 2551, "file_size": 134829106, "table_properties": {"data_size": 134219735, "index_size": 1009070, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:14:20.804369 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 42] Generated table #2552: 3548182 keys, 134828893 bytes
- 2018/07/27-05:14:20.817289 741ff390 EVENT_LOG_v1 {"time_micros": 1532668460817171, "cf_name": "default", "job": 42, "event": "table_file_creation", "file_number": 2552, "file_size": 134828893, "table_properties": {"data_size": 134219592, "index_size": 1009110, "filter_size": 0, "raw_key_size": 145475462, "raw_average_key_size": 41, "raw_value_size": 14192728, "raw_average_value_size": 4, "num_data_blocks": 38992, "num_entries": 3548182, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:14:26.796960 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 42] Generated table #2553: 627485 keys, 23844572 bytes
- 2018/07/27-05:14:26.797223 741ff390 EVENT_LOG_v1 {"time_micros": 1532668466797132, "cf_name": "default", "job": 42, "event": "table_file_creation", "file_number": 2553, "file_size": 23844572, "table_properties": {"data_size": 23736121, "index_size": 177977, "filter_size": 0, "raw_key_size": 25726885, "raw_average_key_size": 41, "raw_value_size": 2509940, "raw_average_value_size": 4, "num_data_blocks": 6896, "num_entries": 627485, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:14:26.885365 741ff390 [rocksdb/db/compaction_job.cc:1287] [default] [JOB 42] Compacted 2@1 + 3@2 files to L2 => 563160671 bytes
- 2018/07/27-05:14:27.072015 741ff390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 26 level-0 files rate 922332
- 2018/07/27-05:14:27.072281 741ff390 (Original Log Time 2018/07/27-05:14:27.071819) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[26 18 137 23 0 0 0] max score 8.34, MB/sec: 5.6 rd, 5.3 wr, level 2, files in(2, 3) out(5) MB in(229.7, 343.8) out(537.1), read-write-amplify(4.8) write-amplify(2.3) OK, records in: 0, records dropped: 0 output_compression: Snappy
- 2018/07/27-05:14:27.072321 741ff390 (Original Log Time 2018/07/27-05:14:27.071968) EVENT_LOG_v1 {"time_micros": 1532668467071899, "job": 42, "event": "compaction_finished", "compaction_time_micros": 107247877, "output_level": 2, "num_output_files": 5, "total_output_size": 563160671, "num_input_records": 14819394, "num_output_records": 14819394, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [26, 18, 137, 23, 0, 0, 0]}
- 2018/07/27-05:14:27.135345 741ff390 EVENT_LOG_v1 {"time_micros": 1532668467135315, "job": 42, "event": "table_file_deletion", "file_number": 2327}
- 2018/07/27-05:14:27.145762 741ff390 EVENT_LOG_v1 {"time_micros": 1532668467145737, "job": 42, "event": "table_file_deletion", "file_number": 2326}
- 2018/07/27-05:14:27.196512 741ff390 EVENT_LOG_v1 {"time_micros": 1532668467196485, "job": 42, "event": "table_file_deletion", "file_number": 1829}
- 2018/07/27-05:14:27.216897 741ff390 EVENT_LOG_v1 {"time_micros": 1532668467216870, "job": 42, "event": "table_file_deletion", "file_number": 1828}
- 2018/07/27-05:14:27.217516 741ff390 EVENT_LOG_v1 {"time_micros": 1532668467217495, "job": 42, "event": "table_file_deletion", "file_number": 1827}
- 2018/07/27-05:14:27.275413 741ff390 [rocksdb/db/compaction_job.cc:1531] [default] [JOB 43] Compacting 26@0 + 18@1 files to L1, score 8.34
- 2018/07/27-05:14:27.275534 741ff390 [rocksdb/db/compaction_job.cc:1535] [default] Compaction start summary: Base version 42 Base level 0, inputs: [2544(87MB) 2534(82MB) 2525(81MB) 2517(90MB) 2510(95MB) 2501(91MB) 2494(94MB) 2485(86MB) 2470(90MB) 2461(97MB) 2449(91MB) 2442(96MB) 2434(79MB) 2427(85MB) 2419(87MB) 2412(99MB) 2404(86MB) 2396(90MB) 2389(77MB) 2381(82MB) 2374(85MB) 2367(92MB) 2349(949B) 2346(42MB) 2345(44MB) 2315(94MB)], [2305(117MB) 2311(63MB) 2318(82MB) 2325(128MB) 2328(128MB) 2331(128MB) 2332(128MB) 2333(128MB) 2334(128MB) 2335(128MB) 2336(128MB) 2337(128MB) 2338(128MB) 2339(128MB) 2340(128MB) 2341(128MB) 2342(128MB) 2343(34MB)]
- 2018/07/27-05:14:27.285108 741ff390 EVENT_LOG_v1 {"time_micros": 1532668467275566, "job": 43, "event": "compaction_started", "compaction_reason": "LevelL0FilesNum", "files_L0": [2544, 2534, 2525, 2517, 2510, 2501, 2494, 2485, 2470, 2461, 2449, 2442, 2434, 2427, 2419, 2412, 2404, 2396, 2389, 2381, 2374, 2367, 2349, 2346, 2345, 2315], "files_L1": [2305, 2311, 2318, 2325, 2328, 2331, 2332, 2333, 2334, 2335, 2336, 2337, 2338, 2339, 2340, 2341, 2342, 2343], "score": 8.33584, "input_data_size": 4435923609}
- 2018/07/27-05:15:11.235244 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2555. Immutable memtables: 1.
- 2018/07/27-05:15:11.284255 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 26 level-0 files rate 737865
- 2018/07/27-05:15:11.343591 739fe390 [rocksdb/db/db_impl_compaction_flush.cc:80] [JOB 44] Syncing log #2550
- 2018/07/27-05:15:11.363330 739fe390 (Original Log Time 2018/07/27-05:15:11.343558) [rocksdb/db/db_impl_compaction_flush.cc:1424] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 1
- 2018/07/27-05:15:11.363358 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 44] Flushing memtable with next log file: 2550
- 2018/07/27-05:15:11.363379 739fe390 [rocksdb/db/flush_job.cc:301] [default] [JOB 44] Flushing memtable with next log file: 2555
- 2018/07/27-05:15:11.366463 739fe390 EVENT_LOG_v1 {"time_micros": 1532668511365007, "job": 44, "event": "flush_started", "num_memtables": 2, "num_entries": 4705324, "num_deletes": 0, "memory_usage": 187481692, "flush_reason": "Write Buffer Full"}
- 2018/07/27-05:15:11.382381 739fe390 [rocksdb/db/flush_job.cc:331] [default] [JOB 44] Level-0 flush table #2556: started
- 2018/07/27-05:15:12.773398 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 43] Generated table #2554: 6364263 keys, 134977329 bytes
- 2018/07/27-05:15:12.773538 741ff390 EVENT_LOG_v1 {"time_micros": 1532668512773455, "cf_name": "default", "job": 43, "event": "table_file_creation", "file_number": 2554, "file_size": 134977329, "table_properties": {"data_size": 134220445, "index_size": 1086302, "filter_size": 0, "raw_key_size": 171977883, "raw_average_key_size": 27, "raw_value_size": 816000, "raw_average_value_size": 0, "num_data_blocks": 38203, "num_entries": 6364263, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:15:38.277018 739fe390 EVENT_LOG_v1 {"time_micros": 1532668538276860, "cf_name": "default", "job": 44, "event": "table_file_creation", "file_number": 2556, "file_size": 115292692, "table_properties": {"data_size": 114714864, "index_size": 851965, "filter_size": 0, "raw_key_size": 133598222, "raw_average_key_size": 28, "raw_value_size": 3125336, "raw_average_value_size": 0, "num_data_blocks": 31989, "num_entries": 4694828, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:15:38.369439 739fe390 [rocksdb/db/flush_job.cc:371] [default] [JOB 44] Level-0 flush table #2556: 115292692 bytes OK
- 2018/07/27-05:15:38.491264 739fe390 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 27 level-0 files rate 590292
- 2018/07/27-05:15:38.491974 739fe390 (Original Log Time 2018/07/27-05:15:38.385307) [rocksdb/db/memtable_list.cc:377] [default] Level-0 commit table #2556 started
- 2018/07/27-05:15:38.491986 739fe390 (Original Log Time 2018/07/27-05:15:38.490873) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2556: memtable #1 done
- 2018/07/27-05:15:38.491995 739fe390 (Original Log Time 2018/07/27-05:15:38.490887) [rocksdb/db/memtable_list.cc:409] [default] Level-0 commit table #2556: memtable #2 done
- 2018/07/27-05:15:38.492004 739fe390 (Original Log Time 2018/07/27-05:15:38.490974) EVENT_LOG_v1 {"time_micros": 1532668538490928, "job": 44, "event": "flush_finished", "output_compression": "Snappy", "lsm_state": [27, 18, 137, 23, 0, 0, 0], "immutable_memtables": 0}
- 2018/07/27-05:15:38.492012 739fe390 (Original Log Time 2018/07/27-05:15:38.491323) [rocksdb/db/db_impl_compaction_flush.cc:177] [default] Level summary: base level 1 max bytes base 268435456 files[27 18 137 23 0 0 0] max score 6.62
- 2018/07/27-05:15:38.492241 739fe390 [rocksdb/db/db_impl_files.cc:342] [JOB 44] Try to delete WAL files size 113468994, prev total WAL file size 113468994, number of live WAL files 3.
- 2018/07/27-05:15:55.219075 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 43] Generated table #2557: 6399015 keys, 134978409 bytes
- 2018/07/27-05:15:55.219486 741ff390 EVENT_LOG_v1 {"time_micros": 1532668555219325, "cf_name": "default", "job": 43, "event": "table_file_creation", "file_number": 2557, "file_size": 134978409, "table_properties": {"data_size": 134221242, "index_size": 1086211, "filter_size": 0, "raw_key_size": 172773405, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 38167, "num_entries": 6399015, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:16:26.989877 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 43] Generated table #2558: 6447960 keys, 134980473 bytes
- 2018/07/27-05:16:27.034950 741ff390 EVENT_LOG_v1 {"time_micros": 1532668587034849, "cf_name": "default", "job": 43, "event": "table_file_creation", "file_number": 2558, "file_size": 134980473, "table_properties": {"data_size": 134219771, "index_size": 1094022, "filter_size": 0, "raw_key_size": 174094920, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 38229, "num_entries": 6447960, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:16:30.974429 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 43] Generated table #2559: 884801 keys, 18458242 bytes
- 2018/07/27-05:16:30.974537 741ff390 EVENT_LOG_v1 {"time_micros": 1532668590974480, "cf_name": "default", "job": 43, "event": "table_file_creation", "file_number": 2559, "file_size": 18458242, "table_properties": {"data_size": 18353468, "index_size": 149860, "filter_size": 0, "raw_key_size": 23889627, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 5226, "num_entries": 884801, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:16:51.632640 76f71d30 [rocksdb/db/db_impl_write.cc:1373] [default] New memtable created with log file: #2561. Immutable memtables: 0.
- 2018/07/27-05:16:51.632782 76f71d30 [WARN] [rocksdb/db/column_family.cc:799] [default] Stalling writes because we have 27 level-0 files rate 472233
- 2018/07/27-05:17:03.803340 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 43] Generated table #2560: 6503265 keys, 134984237 bytes
- 2018/07/27-05:17:03.803568 741ff390 EVENT_LOG_v1 {"time_micros": 1532668623803485, "cf_name": "default", "job": 43, "event": "table_file_creation", "file_number": 2560, "file_size": 134984237, "table_properties": {"data_size": 134221087, "index_size": 1102273, "filter_size": 0, "raw_key_size": 175588155, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 38394, "num_entries": 6503265, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:17:33.814805 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 43] Generated table #2562: 6417463 keys, 134977270 bytes
- 2018/07/27-05:17:33.815042 741ff390 EVENT_LOG_v1 {"time_micros": 1532668653814958, "cf_name": "default", "job": 43, "event": "table_file_creation", "file_number": 2562, "file_size": 134977270, "table_properties": {"data_size": 134219261, "index_size": 1088505, "filter_size": 0, "raw_key_size": 173271501, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 38240, "num_entries": 6417463, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:18:05.582282 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 43] Generated table #2563: 6403613 keys, 134976977 bytes
- 2018/07/27-05:18:05.611652 741ff390 EVENT_LOG_v1 {"time_micros": 1532668685611572, "cf_name": "default", "job": 43, "event": "table_file_creation", "file_number": 2563, "file_size": 134976977, "table_properties": {"data_size": 134219846, "index_size": 1086104, "filter_size": 0, "raw_key_size": 172897551, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 38190, "num_entries": 6403613, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:18:18.724829 741ff390 [rocksdb/db/compaction_job.cc:1211] [default] [JOB 43] Generated table #2564: 2776611 keys, 58763978 bytes
- 2018/07/27-05:18:18.725042 741ff390 EVENT_LOG_v1 {"time_micros": 1532668698724966, "cf_name": "default", "job": 43, "event": "table_file_creation", "file_number": 2564, "file_size": 58763978, "table_properties": {"data_size": 58434900, "index_size": 470758, "filter_size": 0, "raw_key_size": 74968497, "raw_average_key_size": 27, "raw_value_size": 0, "raw_average_value_size": 0, "num_data_blocks": 16577, "num_entries": 2776611, "filter_policy_name": "", "kDeletedKeys": "0", "kMergeOperands": "0"}}
- 2018/07/27-05:18:46.102714 76f71d30 [rocksdb/db/db_impl.cc:252] Shutdown: canceling all background work
- 2018/07/27-05:18:46.260475 741ff390 (Original Log Time 2018/07/27-05:18:46.247246) [rocksdb/db/compaction_job.cc:685] [default] compacted to: base level 1 max bytes base 268435456 files[27 18 137 23 0 0 0] max score 6.62, MB/sec: 17.1 rd, 3.4 wr, level 1, files in(26, 18) out(9) MB in(2134.0, 2096.5) out(846.0), read-write-amplify(2.4) write-amplify(0.4) Shutdown in progress: Database shutdown or Column family drop during compaction, records in: 103459688, records dropped: 24 output_compression: Snappy
- 2018/07/27-05:18:46.260503 741ff390 (Original Log Time 2018/07/27-05:18:46.247691) EVENT_LOG_v1 {"time_micros": 1532668726247307, "job": 43, "event": "compaction_finished", "compaction_time_micros": 258961961, "output_level": 1, "num_output_files": 9, "total_output_size": 1011613149, "num_input_records": 48367570, "num_output_records": 48367546, "num_subcompactions": 1, "output_compression": "Snappy", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [27, 18, 137, 23, 0, 0, 0]}
- 2018/07/27-05:18:46.381200 76f71d30 EVENT_LOG_v1 {"time_micros": 1532668726381169, "job": 45, "event": "table_file_deletion", "file_number": 2565}
- 2018/07/27-05:18:46.424702 76f71d30 EVENT_LOG_v1 {"time_micros": 1532668726424674, "job": 45, "event": "table_file_deletion", "file_number": 2564}
- 2018/07/27-05:18:46.463005 76f71d30 EVENT_LOG_v1 {"time_micros": 1532668726462978, "job": 45, "event": "table_file_deletion", "file_number": 2563}
- 2018/07/27-05:18:46.474390 76f71d30 EVENT_LOG_v1 {"time_micros": 1532668726474368, "job": 45, "event": "table_file_deletion", "file_number": 2562}
- 2018/07/27-05:18:46.485492 76f71d30 EVENT_LOG_v1 {"time_micros": 1532668726485475, "job": 45, "event": "table_file_deletion", "file_number": 2560}
- 2018/07/27-05:18:46.487166 76f71d30 EVENT_LOG_v1 {"time_micros": 1532668726487152, "job": 45, "event": "table_file_deletion", "file_number": 2559}
- 2018/07/27-05:18:46.498834 76f71d30 EVENT_LOG_v1 {"time_micros": 1532668726498815, "job": 45, "event": "table_file_deletion", "file_number": 2558}
- 2018/07/27-05:18:46.535575 76f71d30 EVENT_LOG_v1 {"time_micros": 1532668726535552, "job": 45, "event": "table_file_deletion", "file_number": 2557}
- 2018/07/27-05:18:46.535853 76f71d30 EVENT_LOG_v1 {"time_micros": 1532668726535839, "job": 45, "event": "table_file_deletion", "file_number": 2554}
- 2018/07/27-05:18:46.742682 76f71d30 [rocksdb/db/db_impl.cc:398] Shutdown complete
Advertisement
Add Comment
Please, Sign In to add comment